2023-07-20T14:46:40.656 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-20T14:46:40.658 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi --owner scheduled_yuriw@teuthology --description rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} --verbose --archive /home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344744 -- /home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344744/orig.config.yaml 2023-07-20T14:46:40.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T14:46:40.765 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344744 branch: wip-yuri11-testing-2023-07-18-0927-pacific description: rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} email: null first_in_suite: false job_id: '7344744' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri11-testing-2023-07-18-0927-pacific ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: e20180733e4b085d1abe55675eb8c828b0bfedec ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: e20180733e4b085d1abe55675eb8c828b0bfedec workunit: branch: wip-yuri11-testing-2023-07-18-0927-pacific sha1: e20180733e4b085d1abe55675eb8c828b0bfedec owner: scheduled_yuriw@teuthology priority: 95 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b seed: 7528 sha1: e20180733e4b085d1abe55675eb8c828b0bfedec sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri11-testing-2023-07-18-0927-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_e20180733e4b085d1abe55675eb8c828b0bfedec/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: e20180733e4b085d1abe55675eb8c828b0bfedec targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMXto2wFjvs7fQdmwJRE7emCUnrJz4bhhDfFJaNs9byXJ7bFQiVuzXXX7+zXu0Oy4L0oBzK72Cr013V96NWZSMQ= smithi178.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDF5+YVRmvOD2mNlTnr16YnQVBvcMvmgdz1UfZjaHtEg3e0Kz6Se48m9gn4GRbPFHV0e2yfG6kr4mWYcsrJizd1u9VqvE17S7WgYmNOWNKcYFrNPucGlADEkd5HprWMojIvR/yd+MDM54kNH44qCloJLe2XlcjJ+bc/akQjkTEOml6AkgG3JkcqvO2OZ0lP7u3mvazZW8VNMeLjgm4aH5NEb3LDn3uC1dWzpP0gcjpDUsOs12nH9ut66e6UNp+Zo3nx2yb+wzLMaMNa+Yc4/Hp4+Ebjz4xFHRHoNnBCtCAIXRdNI0GFh8tl3UXE0qW3pVaF/sxMiIhrXnTn/0MSiaoal/hLy47Tz+CuWMo1cODxGJpRZ8Dnru6bMhjj6f47Q+3+srWV9RbUxUKH5417n/GNS9Uue1rqKHlGkQndK6vBph4lWI5nM2t75OaFlskpk9Shi4qADVW3iWmYfYRawjrvhg4cmJ5nkU+ty6WH77qKQtmsdrrqHcheAMRsVE2kAh8= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - cephadm: add_mons_via_daemon_add: true allow_ptrace: false avoid_pacific_features: true cephadm_branch: v15.2.0 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v15.2.0 - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw r z --placement=2 --port=8000 - sleep 120 - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - ceph orch ls | grep '^osd ' - cephadm.shell: mon.a: - ceph orch upgrade ls - ceph orch upgrade ls --image quay.io/ceph/ceph | grep 16.2.0 - ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 79491cb69dd37a1eafb93b3471998174bdfa2fd9 timestamp: 2023-07-20_14:33:07 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-20T14:46:40.765 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_e20180733e4b085d1abe55675eb8c828b0bfedec/qa; will attempt to use it 2023-07-20T14:46:40.766 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_e20180733e4b085d1abe55675eb8c828b0bfedec/qa/tasks 2023-07-20T14:46:40.767 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-20T14:46:40.768 INFO:teuthology.task.internal:Checking packages... 2023-07-20T14:46:40.797 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e20180733e4b085d1abe55675eb8c828b0bfedec' 2023-07-20T14:46:40.798 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-20T14:46:40.798 INFO:teuthology.packaging:ref: None 2023-07-20T14:46:40.799 INFO:teuthology.packaging:tag: None 2023-07-20T14:46:40.799 INFO:teuthology.packaging:branch: wip-yuri11-testing-2023-07-18-0927-pacific 2023-07-20T14:46:40.799 INFO:teuthology.packaging:sha1: e20180733e4b085d1abe55675eb8c828b0bfedec 2023-07-20T14:46:40.799 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri11-testing-2023-07-18-0927-pacific 2023-07-20T14:46:41.128 INFO:teuthology.task.internal:Found packages for ceph version 16.2.13-355.ge2018073 2023-07-20T14:46:41.128 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-20T14:46:41.135 INFO:teuthology.task.internal:no buildpackages task found 2023-07-20T14:46:41.136 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-20T14:46:41.153 INFO:teuthology.task.internal:Saving configuration 2023-07-20T14:46:41.165 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-20T14:46:41.174 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T14:46:41.201 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 14:35:25.340065', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMXto2wFjvs7fQdmwJRE7emCUnrJz4bhhDfFJaNs9byXJ7bFQiVuzXXX7+zXu0Oy4L0oBzK72Cr013V96NWZSMQ='} 2023-07-20T14:46:41.224 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 14:35:25.338281', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKmigMp0UsBG/avNJDd3V7oFpZFrdREAhL0554Htszueu2lNdv6QTV1CUaC+tHRQmz2JYUFqo5sYbW8E7HS71aQ='} 2023-07-20T14:46:41.225 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-20T14:46:41.232 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2023-07-20T14:46:41.233 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2023-07-20T14:46:41.233 INFO:teuthology.run_tasks:Running task console_log... 2023-07-20T14:46:41.314 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f99444344c0>, signals=[15]) 2023-07-20T14:46:41.315 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-20T14:46:41.323 INFO:teuthology.task.internal:Opening connections... 2023-07-20T14:46:41.324 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2023-07-20T14:46:41.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:46:41.393 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2023-07-20T14:46:41.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:46:41.461 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-20T14:46:41.469 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2023-07-20T14:46:41.492 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2023-07-20T14:46:41.492 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-07-20T14:46:41.554 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2023-07-20T14:46:41.555 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8" 2023-07-20T14:46:41.555 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2023-07-20T14:46:41.555 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2023-07-20T14:46:41.555 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8" 2023-07-20T14:46:41.555 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2023-07-20T14:46:41.555 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-20T14:46:41.556 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-07-20T14:46:41.556 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-20T14:46:41.556 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2023-07-20T14:46:41.556 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T14:46:41.556 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T14:46:41.556 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-20T14:46:41.557 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-07-20T14:46:41.579 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2023-07-20T14:46:41.602 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2023-07-20T14:46:41.602 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-07-20T14:46:41.662 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream" 2023-07-20T14:46:41.662 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8" 2023-07-20T14:46:41.662 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos" 2023-07-20T14:46:41.662 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora" 2023-07-20T14:46:41.662 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8" 2023-07-20T14:46:41.663 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2023-07-20T14:46:41.663 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-20T14:46:41.663 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2023-07-20T14:46:41.663 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-20T14:46:41.663 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/" 2023-07-20T14:46:41.663 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T14:46:41.663 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T14:46:41.664 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-20T14:46:41.664 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-07-20T14:46:41.694 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-20T14:46:41.704 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-20T14:46:41.712 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-20T14:46:41.712 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2023-07-20T14:46:41.715 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2023-07-20T14:46:41.735 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-20T14:46:41.742 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-20T14:46:41.743 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2023-07-20T14:46:41.775 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2023-07-20T14:46:41.804 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-20T14:46:41.868 INFO:teuthology.run_tasks:Running task kernel... 2023-07-20T14:46:41.888 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-07-20T14:46:41.889 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-07-20T14:46:41.889 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-20T14:46:41.890 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-20T14:46:41.909 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T14:46:41.910 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2023-07-20T14:46:41.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T14:46:41.911 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2023-07-20T14:46:41.969 INFO:teuthology.orchestra.run.smithi178.stdout:4.18.0-489.el8.x86_64 2023-07-20T14:46:41.970 INFO:teuthology.task.kernel:Running kernel on smithi178: 4.18.0-489.el8.x86_64 2023-07-20T14:46:41.970 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum install -y kernel 2023-07-20T14:46:41.973 INFO:teuthology.orchestra.run.smithi029.stdout:4.18.0-489.el8.x86_64 2023-07-20T14:46:41.973 INFO:teuthology.task.kernel:Running kernel on smithi029: 4.18.0-489.el8.x86_64 2023-07-20T14:46:41.973 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum install -y kernel 2023-07-20T14:46:51.979 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - AppStream 5.5 MB/s | 31 MB 00:05 2023-07-20T14:46:52.544 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 8 - AppStream 3.8 MB/s | 31 MB 00:07 2023-07-20T14:47:02.191 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 8 - BaseOS 10 MB/s | 41 MB 00:04 2023-07-20T14:47:07.647 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - BaseOS 4.2 MB/s | 41 MB 00:09 2023-07-20T14:47:08.427 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 8 - Extras 64 kB/s | 18 kB 00:00 2023-07-20T14:47:09.152 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.6 kB 00:00 2023-07-20T14:47:09.654 INFO:teuthology.orchestra.run.smithi178.stdout:Copr repo for python3-asyncssh owned by ceph 9.7 kB/s | 3.5 kB 00:00 2023-07-20T14:47:12.396 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 6.0 MB/s | 16 MB 00:02 2023-07-20T14:47:14.466 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - Extras 41 kB/s | 18 kB 00:00 2023-07-20T14:47:15.392 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - Extras common packages 8.8 kB/s | 6.6 kB 00:00 2023-07-20T14:47:15.746 INFO:teuthology.orchestra.run.smithi029.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-07-20T14:47:16.113 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 439 kB/s | 24 kB 00:00 2023-07-20T14:47:17.056 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-07-20T14:47:19.362 INFO:teuthology.orchestra.run.smithi178.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-07-20T14:47:19.363 INFO:teuthology.orchestra.run.smithi178.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-07-20T14:47:19.602 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-07-20T14:47:19.603 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-07-20T14:47:19.603 INFO:teuthology.orchestra.run.smithi178.stdout: Package Architecture Version Repository Size 2023-07-20T14:47:19.603 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-07-20T14:47:19.603 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-07-20T14:47:19.603 INFO:teuthology.orchestra.run.smithi178.stdout: kernel x86_64 4.18.0-500.el8 baseos 9.8 M 2023-07-20T14:47:19.603 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2023-07-20T14:47:19.603 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-core x86_64 4.18.0-500.el8 baseos 43 M 2023-07-20T14:47:19.604 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules x86_64 4.18.0-500.el8 baseos 35 M 2023-07-20T14:47:19.604 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-07-20T14:47:19.604 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-07-20T14:47:19.604 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-07-20T14:47:19.604 INFO:teuthology.orchestra.run.smithi178.stdout:Install 3 Packages 2023-07-20T14:47:19.604 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-07-20T14:47:19.605 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 88 M 2023-07-20T14:47:19.605 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 95 M 2023-07-20T14:47:19.605 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-07-20T14:47:21.041 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 385 kB/s | 24 kB 00:00 2023-07-20T14:47:22.382 INFO:teuthology.orchestra.run.smithi178.stdout:(1/3): kernel-4.18.0-500.el8.x86_64.rpm 3.7 MB/s | 9.8 MB 00:02 2023-07-20T14:47:24.400 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-07-20T14:47:24.400 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-07-20T14:47:24.661 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-07-20T14:47:24.661 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-07-20T14:47:24.662 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2023-07-20T14:47:24.662 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-07-20T14:47:24.662 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-07-20T14:47:24.662 INFO:teuthology.orchestra.run.smithi029.stdout: kernel x86_64 4.18.0-500.el8 baseos 9.8 M 2023-07-20T14:47:24.662 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2023-07-20T14:47:24.662 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core x86_64 4.18.0-500.el8 baseos 43 M 2023-07-20T14:47:24.663 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules x86_64 4.18.0-500.el8 baseos 35 M 2023-07-20T14:47:24.663 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T14:47:24.663 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-07-20T14:47:24.663 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-07-20T14:47:24.663 INFO:teuthology.orchestra.run.smithi029.stdout:Install 3 Packages 2023-07-20T14:47:24.663 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T14:47:24.664 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 88 M 2023-07-20T14:47:24.664 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 95 M 2023-07-20T14:47:24.664 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-07-20T14:47:26.996 INFO:teuthology.orchestra.run.smithi029.stdout:(1/3): kernel-4.18.0-500.el8.x86_64.rpm 4.3 MB/s | 9.8 MB 00:02 2023-07-20T14:47:28.529 INFO:teuthology.orchestra.run.smithi029.stdout:(2/3): kernel-modules-4.18.0-500.el8.x86_64.rpm 9.3 MB/s | 35 MB 00:03 2023-07-20T14:47:29.847 INFO:teuthology.orchestra.run.smithi029.stdout:(3/3): kernel-core-4.18.0-500.el8.x86_64.rpm 8.3 MB/s | 43 MB 00:05 2023-07-20T14:47:29.847 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-07-20T14:47:29.848 INFO:teuthology.orchestra.run.smithi029.stdout:Total 17 MB/s | 88 MB 00:05 2023-07-20T14:47:30.542 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-07-20T14:47:30.923 INFO:teuthology.orchestra.run.smithi178.stdout:(2/3): kernel-core-4.18.0-500.el8.x86_64.rpm 3.8 MB/s | 43 MB 00:11 2023-07-20T14:47:31.071 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-07-20T14:47:31.072 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-07-20T14:47:32.334 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-07-20T14:47:32.354 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-07-20T14:47:35.249 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-07-20T14:47:35.892 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-core-4.18.0-500.el8.x86_64 1/3 2023-07-20T14:47:39.618 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 1/3 2023-07-20T14:47:40.116 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-07-20T14:47:40.538 INFO:teuthology.orchestra.run.smithi178.stdout:(3/3): kernel-modules-4.18.0-500.el8.x86_64.rpm 1.7 MB/s | 35 MB 00:20 2023-07-20T14:47:40.539 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-07-20T14:47:40.539 INFO:teuthology.orchestra.run.smithi178.stdout:Total 4.2 MB/s | 88 MB 00:20 2023-07-20T14:47:41.201 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-07-20T14:47:41.650 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-07-20T14:47:41.651 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-07-20T14:47:42.871 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-07-20T14:47:42.903 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-07-20T14:47:43.715 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-07-20T14:47:44.065 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-4.18.0-500.el8.x86_64 3/3 2023-07-20T14:47:45.717 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-07-20T14:47:46.267 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-core-4.18.0-500.el8.x86_64 1/3 2023-07-20T14:47:49.872 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 1/3 2023-07-20T14:47:50.399 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-07-20T14:47:53.754 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-07-20T14:47:54.085 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-4.18.0-500.el8.x86_64 3/3 2023-07-20T14:48:08.377 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 3/3 2023-07-20T14:48:08.400 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-07-20T14:48:08.757 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-4.18.0-500.el8.x86_64 3/3 2023-07-20T14:48:08.757 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-4.18.0-500.el8.x86_64 1/3 2023-07-20T14:48:08.758 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-core-4.18.0-500.el8.x86_64 2/3 2023-07-20T14:48:09.479 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-07-20T14:48:09.479 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T14:48:09.479 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-07-20T14:48:09.479 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-4.18.0-500.el8.x86_64 kernel-core-4.18.0-500.el8.x86_64 2023-07-20T14:48:09.480 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-4.18.0-500.el8.x86_64 2023-07-20T14:48:09.480 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T14:48:09.480 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-07-20T14:48:09.635 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2023-07-20T14:48:09.860 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-4.18.0-500.el8.x86_64 2023-07-20T14:48:09.860 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-07-20T14:48:09.861 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-500.el8.x86_64 2023-07-20T14:48:09.861 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-07-20T14:48:09.861 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-07-20T14:48:09.861 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-07-20T14:48:09.861 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi029.front.sepia.ceph.com, path=None, version=distro) 2023-07-20T14:48:09.861 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2023-07-20T14:48:10.077 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-4.18.0-500.el8.x86_64 2023-07-20T14:48:10.078 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-07-20T14:48:10.079 DEBUG:teuthology.orchestra.run.smithi029:> sudo rpm -qi grub2-tools 2023-07-20T14:48:10.113 INFO:teuthology.orchestra.run.smithi029.stdout:Name : grub2-tools 2023-07-20T14:48:10.114 INFO:teuthology.orchestra.run.smithi029.stdout:Epoch : 1 2023-07-20T14:48:10.114 INFO:teuthology.orchestra.run.smithi029.stdout:Version : 2.02 2023-07-20T14:48:10.114 INFO:teuthology.orchestra.run.smithi029.stdout:Release : 129.el8 2023-07-20T14:48:10.114 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: x86_64 2023-07-20T14:48:10.114 INFO:teuthology.orchestra.run.smithi029.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-20T14:48:10.114 INFO:teuthology.orchestra.run.smithi029.stdout:Group : System Environment/Base 2023-07-20T14:48:10.114 INFO:teuthology.orchestra.run.smithi029.stdout:Size : 9265586 2023-07-20T14:48:10.115 INFO:teuthology.orchestra.run.smithi029.stdout:License : GPLv3+ 2023-07-20T14:48:10.115 INFO:teuthology.orchestra.run.smithi029.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-20T14:48:10.115 INFO:teuthology.orchestra.run.smithi029.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-20T14:48:10.115 INFO:teuthology.orchestra.run.smithi029.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-20T14:48:10.115 INFO:teuthology.orchestra.run.smithi029.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-20T14:48:10.115 INFO:teuthology.orchestra.run.smithi029.stdout:Relocations : (not relocatable) 2023-07-20T14:48:10.115 INFO:teuthology.orchestra.run.smithi029.stdout:Packager : CentOS BuildSystem 2023-07-20T14:48:10.115 INFO:teuthology.orchestra.run.smithi029.stdout:Vendor : CentOS 2023-07-20T14:48:10.116 INFO:teuthology.orchestra.run.smithi029.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-20T14:48:10.116 INFO:teuthology.orchestra.run.smithi029.stdout:Summary : Support tools for GRUB. 2023-07-20T14:48:10.116 INFO:teuthology.orchestra.run.smithi029.stdout:Description : 2023-07-20T14:48:10.116 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T14:48:10.116 INFO:teuthology.orchestra.run.smithi029.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-20T14:48:10.116 INFO:teuthology.orchestra.run.smithi029.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-20T14:48:10.116 INFO:teuthology.orchestra.run.smithi029.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-20T14:48:10.117 INFO:teuthology.orchestra.run.smithi029.stdout:hardware devices. 2023-07-20T14:48:10.117 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T14:48:10.117 INFO:teuthology.orchestra.run.smithi029.stdout:This subpackage provides tools for support of all platforms. 2023-07-20T14:48:10.118 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-20T14:48:10.118 INFO:teuthology.task.kernel:Updating grub on smithi029 to boot 4.18.0-500.el8.x86_64 2023-07-20T14:48:10.118 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-20T14:48:12.127 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2023-07-20T14:48:14.614 INFO:teuthology.orchestra.run.smithi029.stderr:done 2023-07-20T14:48:14.616 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2023-07-20T14:48:14.670 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.xTElj1ai95 2023-07-20T14:48:14.671 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xTElj1ai95 2023-07-20T14:48:14.703 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.xTElj1ai95 2023-07-20T14:48:14.855 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.xTElj1ai95 is 6KB 2023-07-20T14:48:14.902 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.xTElj1ai95 2023-07-20T14:48:14.920 DEBUG:teuthology.orchestra.run.smithi029:> sudo /bin/ls /boot/loader/entries || true 2023-07-20T14:48:14.986 INFO:teuthology.orchestra.run.smithi029.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-20T14:48:14.986 INFO:teuthology.orchestra.run.smithi029.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-20T14:48:14.986 INFO:teuthology.orchestra.run.smithi029.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-20T14:48:14.986 INFO:teuthology.orchestra.run.smithi029.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64.conf 2023-07-20T14:48:14.987 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64 2023-07-20T14:48:15.152 DEBUG:teuthology.orchestra.run.smithi029:> sudo shutdown -r now 2023-07-20T14:48:15.943 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 3/3 2023-07-20T14:48:15.967 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-07-20T14:48:16.418 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-4.18.0-500.el8.x86_64 3/3 2023-07-20T14:48:16.418 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-4.18.0-500.el8.x86_64 1/3 2023-07-20T14:48:16.418 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-core-4.18.0-500.el8.x86_64 2/3 2023-07-20T14:48:17.058 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-07-20T14:48:17.058 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-07-20T14:48:17.058 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-07-20T14:48:17.058 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-4.18.0-500.el8.x86_64 kernel-core-4.18.0-500.el8.x86_64 2023-07-20T14:48:17.058 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules-4.18.0-500.el8.x86_64 2023-07-20T14:48:17.059 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-07-20T14:48:17.059 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-07-20T14:48:17.224 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q kernel | sort -rV | head -n 1 2023-07-20T14:48:17.440 INFO:teuthology.orchestra.run.smithi178.stdout:kernel-4.18.0-500.el8.x86_64 2023-07-20T14:48:17.440 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-07-20T14:48:17.440 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-500.el8.x86_64 2023-07-20T14:48:17.441 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-07-20T14:48:17.441 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-07-20T14:48:17.441 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-07-20T14:48:17.441 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi178.front.sepia.ceph.com, path=None, version=distro) 2023-07-20T14:48:17.441 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q kernel | sort -rV | head -n 1 2023-07-20T14:48:17.649 INFO:teuthology.orchestra.run.smithi178.stdout:kernel-4.18.0-500.el8.x86_64 2023-07-20T14:48:17.650 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-07-20T14:48:17.650 DEBUG:teuthology.orchestra.run.smithi178:> sudo rpm -qi grub2-tools 2023-07-20T14:48:17.683 INFO:teuthology.orchestra.run.smithi178.stdout:Name : grub2-tools 2023-07-20T14:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout:Epoch : 1 2023-07-20T14:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout:Version : 2.02 2023-07-20T14:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout:Release : 129.el8 2023-07-20T14:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout:Architecture: x86_64 2023-07-20T14:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-20T14:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout:Group : System Environment/Base 2023-07-20T14:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout:Size : 9265586 2023-07-20T14:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout:License : GPLv3+ 2023-07-20T14:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-20T14:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-20T14:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-20T14:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-20T14:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout:Relocations : (not relocatable) 2023-07-20T14:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout:Packager : CentOS BuildSystem 2023-07-20T14:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout:Vendor : CentOS 2023-07-20T14:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-20T14:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout:Summary : Support tools for GRUB. 2023-07-20T14:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout:Description : 2023-07-20T14:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-07-20T14:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-20T14:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-20T14:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-20T14:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout:hardware devices. 2023-07-20T14:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-07-20T14:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout:This subpackage provides tools for support of all platforms. 2023-07-20T14:48:17.688 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-20T14:48:17.688 INFO:teuthology.task.kernel:Updating grub on smithi178 to boot 4.18.0-500.el8.x86_64 2023-07-20T14:48:17.688 DEBUG:teuthology.orchestra.run.smithi178:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-20T14:48:19.166 INFO:teuthology.orchestra.run.smithi178.stderr:Generating grub configuration file ... 2023-07-20T14:48:21.076 INFO:teuthology.orchestra.run.smithi178.stderr:done 2023-07-20T14:48:21.078 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2023-07-20T14:48:21.143 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.U1wFaOHkzA 2023-07-20T14:48:21.143 DEBUG:teuthology.orchestra.run.smithi178:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.U1wFaOHkzA 2023-07-20T14:48:21.176 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.U1wFaOHkzA 2023-07-20T14:48:21.316 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.U1wFaOHkzA is 6KB 2023-07-20T14:48:21.363 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.U1wFaOHkzA 2023-07-20T14:48:21.380 DEBUG:teuthology.orchestra.run.smithi178:> sudo /bin/ls /boot/loader/entries || true 2023-07-20T14:48:21.452 INFO:teuthology.orchestra.run.smithi178.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-20T14:48:21.452 INFO:teuthology.orchestra.run.smithi178.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-20T14:48:21.452 INFO:teuthology.orchestra.run.smithi178.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-20T14:48:21.453 INFO:teuthology.orchestra.run.smithi178.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64.conf 2023-07-20T14:48:21.453 DEBUG:teuthology.orchestra.run.smithi178:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64 2023-07-20T14:48:21.591 DEBUG:teuthology.orchestra.run.smithi178:> sudo shutdown -r now 2023-07-20T14:48:45.176 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-07-20T14:48:45.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-07-20T14:48:45.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:48:51.600 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-07-20T14:48:51.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-07-20T14:48:51.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:49:26.132 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-07-20T14:49:35.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-07-20T14:49:35.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:49:38.192 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-07-20T14:49:45.184 DEBUG:teuthology.orchestra.remote:timed out 2023-07-20T14:49:50.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-07-20T14:49:50.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:49:54.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-07-20T14:49:54.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:49:55.578 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-07-20T14:49:55.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-07-20T14:49:55.949 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-500.el8.x86_64"... 2023-07-20T14:49:55.950 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2023-07-20T14:49:55.970 INFO:teuthology.orchestra.run.smithi029.stdout:4.18.0-500.el8.x86_64 2023-07-20T14:49:55.971 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-500.el8.x86_64 vs 4.18.0-500.el8.x86_64 2023-07-20T14:49:55.971 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-20T14:49:55.971 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-20T14:49:56.973 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-07-20T14:49:56.973 DEBUG:teuthology.orchestra.run.smithi029:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-20T14:49:57.071 INFO:teuthology.orchestra.run.smithi029.stdout:ttyS1 2023-07-20T14:49:57.087 DEBUG:teuthology.parallel:result is None 2023-07-20T14:50:22.567 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-07-20T14:50:23.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-07-20T14:50:23.101 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-500.el8.x86_64"... 2023-07-20T14:50:23.102 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2023-07-20T14:50:23.119 INFO:teuthology.orchestra.run.smithi178.stdout:4.18.0-500.el8.x86_64 2023-07-20T14:50:23.120 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-500.el8.x86_64 vs 4.18.0-500.el8.x86_64 2023-07-20T14:50:23.120 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-20T14:50:23.120 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-20T14:50:24.121 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-07-20T14:50:24.122 DEBUG:teuthology.orchestra.run.smithi178:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-20T14:50:24.205 INFO:teuthology.orchestra.run.smithi178.stdout:ttyS1 2023-07-20T14:50:24.223 DEBUG:teuthology.parallel:result is None 2023-07-20T14:50:24.224 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-20T14:50:24.234 INFO:teuthology.task.internal:Creating test directory... 2023-07-20T14:50:24.234 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-20T14:50:24.238 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-20T14:50:24.260 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-20T14:50:24.269 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-20T14:50:24.281 INFO:teuthology.task.internal:Creating archive directory... 2023-07-20T14:50:24.281 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-20T14:50:24.303 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-20T14:50:24.337 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-20T14:50:24.347 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-20T14:50:24.347 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-20T14:50:24.372 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-20T14:50:24.410 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-20T14:50:24.415 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-20T14:50:24.422 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-20T14:50:24.427 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-20T14:50:24.429 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-20T14:50:24.436 INFO:teuthology.task.internal:Configuring sudo... 2023-07-20T14:50:24.437 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-20T14:50:24.439 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-20T14:50:24.493 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-20T14:50:24.504 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-20T14:50:24.505 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-20T14:50:24.510 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-20T14:50:24.553 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-20T14:50:24.618 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-20T14:50:24.674 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-20T14:50:24.721 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-20T14:50:24.765 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-07-20T14:50:24.765 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-20T14:50:24.833 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-20T14:50:24.883 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-20T14:50:24.939 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-20T14:50:25.029 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-20T14:50:25.071 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-07-20T14:50:25.072 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-20T14:50:25.140 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2023-07-20T14:50:25.142 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2023-07-20T14:50:25.219 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-20T14:50:25.246 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-20T14:50:25.718 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-20T14:50:25.726 INFO:teuthology.task.internal:Starting timer... 2023-07-20T14:50:25.727 INFO:teuthology.run_tasks:Running task pcp... 2023-07-20T14:50:25.742 INFO:teuthology.run_tasks:Running task selinux... 2023-07-20T14:50:25.761 DEBUG:teuthology.orchestra.run.smithi029:> sudo service auditd rotate 2023-07-20T14:50:25.853 INFO:teuthology.orchestra.run.smithi029.stdout:Rotating logs: 2023-07-20T14:50:25.854 DEBUG:teuthology.orchestra.run.smithi178:> sudo service auditd rotate 2023-07-20T14:50:25.929 INFO:teuthology.orchestra.run.smithi178.stdout:Rotating logs: 2023-07-20T14:50:25.930 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-20T14:50:25.931 DEBUG:teuthology.orchestra.run.smithi029:> /usr/sbin/getenforce 2023-07-20T14:50:25.961 INFO:teuthology.orchestra.run.smithi029.stdout:Permissive 2023-07-20T14:50:25.961 DEBUG:teuthology.orchestra.run.smithi178:> /usr/sbin/getenforce 2023-07-20T14:50:25.994 INFO:teuthology.orchestra.run.smithi178.stdout:Permissive 2023-07-20T14:50:25.995 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi029.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi178.front.sepia.ceph.com': 'permissive'} 2023-07-20T14:50:25.995 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-20T14:50:26.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T14:50:26.036 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-20T14:50:26.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T14:50:26.066 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-20T14:50:26.066 DEBUG:teuthology.orchestra.run.smithi029:> sudo /usr/sbin/setenforce permissive 2023-07-20T14:50:26.114 DEBUG:teuthology.orchestra.run.smithi178:> sudo /usr/sbin/setenforce permissive 2023-07-20T14:50:26.149 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-20T14:50:26.162 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-07-20T14:50:26.162 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-20T14:50:26.183 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-20T14:50:26.184 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-20T14:58:31.214 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi178.front.sepia.ceph.com')] 2023-07-20T14:58:31.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-07-20T14:58:31.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:58:31.339 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-07-20T14:58:31.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-07-20T14:58:31.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-07-20T14:58:31.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:58:31.505 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-07-20T14:58:31.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-07-20T14:58:31.537 INFO:teuthology.run_tasks:Running task clock... 2023-07-20T14:58:31.588 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-20T14:58:31.589 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-20T14:58:31.589 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-20T14:58:31.594 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-20T14:58:31.595 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-20T14:58:31.632 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-20T14:58:31.642 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-20T14:58:31.653 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-20T14:58:31.654 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-20T14:58:31.718 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: ntpd: command not found 2023-07-20T14:58:31.726 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: ntpd: command not found 2023-07-20T14:58:31.733 INFO:teuthology.orchestra.run.smithi029.stdout:506 Cannot talk to daemon 2023-07-20T14:58:31.734 INFO:teuthology.orchestra.run.smithi178.stdout:506 Cannot talk to daemon 2023-07-20T14:58:31.744 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-20T14:58:31.753 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-20T14:58:31.760 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-20T14:58:31.764 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-20T14:58:31.825 INFO:teuthology.orchestra.run.smithi029.stderr:bash: ntpq: command not found 2023-07-20T14:58:31.830 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-20T14:58:31.831 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2023-07-20T14:58:31.831 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-20T14:58:31.831 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-20T14:58:31.831 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-20T14:58:31.831 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-20T14:58:31.833 INFO:teuthology.orchestra.run.smithi178.stderr:bash: ntpq: command not found 2023-07-20T14:58:31.860 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-20T14:58:31.861 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2023-07-20T14:58:31.861 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-20T14:58:31.861 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-20T14:58:31.861 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-20T14:58:31.861 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-20T14:58:31.862 INFO:teuthology.run_tasks:Running task pexec... 2023-07-20T14:58:31.887 INFO:teuthology.task.pexec:Executing custom commands... 2023-07-20T14:58:31.889 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi029.front.sepia.ceph.com 2023-07-20T14:58:31.889 DEBUG:teuthology.orchestra.run.smithi029:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-07-20T14:58:31.890 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi178.front.sepia.ceph.com 2023-07-20T14:58:31.890 DEBUG:teuthology.orchestra.run.smithi178:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-07-20T14:58:32.766 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:07 ago on Thu 20 Jul 2023 02:56:25 PM UTC. 2023-07-20T14:58:32.796 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:52 ago on Thu 20 Jul 2023 02:56:40 PM UTC. 2023-07-20T14:58:34.438 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-07-20T14:58:34.439 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-07-20T14:58:34.439 INFO:teuthology.orchestra.run.smithi178.stdout: Package Architecture Version Repository Size 2023-07-20T14:58:34.439 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-07-20T14:58:34.440 INFO:teuthology.orchestra.run.smithi178.stdout:Resetting modules: 2023-07-20T14:58:34.440 INFO:teuthology.orchestra.run.smithi178.stdout: container-tools 2023-07-20T14:58:34.440 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-07-20T14:58:34.440 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-07-20T14:58:34.441 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-07-20T14:58:34.441 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-07-20T14:58:34.588 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-07-20T14:58:34.590 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-07-20T14:58:34.590 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2023-07-20T14:58:34.590 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-07-20T14:58:34.590 INFO:teuthology.orchestra.run.smithi029.stdout:Resetting modules: 2023-07-20T14:58:34.591 INFO:teuthology.orchestra.run.smithi029.stdout: container-tools 2023-07-20T14:58:34.591 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T14:58:34.591 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-07-20T14:58:34.591 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-07-20T14:58:34.591 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T14:58:34.708 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-07-20T14:58:34.851 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-07-20T14:58:35.655 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:10 ago on Thu 20 Jul 2023 02:56:25 PM UTC. 2023-07-20T14:58:35.781 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:55 ago on Thu 20 Jul 2023 02:56:40 PM UTC. 2023-07-20T14:58:37.314 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-07-20T14:58:37.320 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================== 2023-07-20T14:58:37.320 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repo Size 2023-07-20T14:58:37.320 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================== 2023-07-20T14:58:37.321 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrading: 2023-07-20T14:58:37.321 INFO:teuthology.orchestra.run.smithi178.stdout: conmon x86_64 3:2.1.7-1.module_el8+454+d7ef4b8d appstream 57 k 2023-07-20T14:58:37.321 INFO:teuthology.orchestra.run.smithi178.stdout: container-selinux noarch 2:2.218.0-1.module_el8+454+d7ef4b8d appstream 69 k 2023-07-20T14:58:37.321 INFO:teuthology.orchestra.run.smithi178.stdout: containernetworking-plugins x86_64 1:1.3.0-2.module_el8+461+0c6b54ea appstream 21 M 2023-07-20T14:58:37.321 INFO:teuthology.orchestra.run.smithi178.stdout: containers-common x86_64 2:1-51.module_el8+454+d7ef4b8d appstream 136 k 2023-07-20T14:58:37.323 INFO:teuthology.orchestra.run.smithi178.stdout: criu x86_64 3.18-4.module_el8+454+d7ef4b8d appstream 564 k 2023-07-20T14:58:37.323 INFO:teuthology.orchestra.run.smithi178.stdout: fuse-overlayfs x86_64 1.12-1.module_el8+454+d7ef4b8d appstream 70 k 2023-07-20T14:58:37.324 INFO:teuthology.orchestra.run.smithi178.stdout: libslirp x86_64 4.4.0-1.module_el8+454+d7ef4b8d appstream 70 k 2023-07-20T14:58:37.324 INFO:teuthology.orchestra.run.smithi178.stdout: runc x86_64 1:1.1.7-2.module_el8+463+b24391b1 appstream 3.1 M 2023-07-20T14:58:37.324 INFO:teuthology.orchestra.run.smithi178.stdout: slirp4netns x86_64 1.2.0-3.module_el8+454+d7ef4b8d appstream 54 k 2023-07-20T14:58:37.324 INFO:teuthology.orchestra.run.smithi178.stdout:Installing group/module packages: 2023-07-20T14:58:37.324 INFO:teuthology.orchestra.run.smithi178.stdout: aardvark-dns x86_64 2:1.6.0-1.module_el8+454+d7ef4b8d appstream 1.0 M 2023-07-20T14:58:37.324 INFO:teuthology.orchestra.run.smithi178.stdout: buildah x86_64 1:1.30.0-2.module_el8+460+8cac93c8 appstream 8.7 M 2023-07-20T14:58:37.325 INFO:teuthology.orchestra.run.smithi178.stdout: cockpit-podman noarch 70-1.module_el8+454+d7ef4b8d appstream 790 k 2023-07-20T14:58:37.325 INFO:teuthology.orchestra.run.smithi178.stdout: crun x86_64 1.8.5-1.module_el8+454+d7ef4b8d appstream 235 k 2023-07-20T14:58:37.325 INFO:teuthology.orchestra.run.smithi178.stdout: netavark x86_64 2:1.6.0-1.module_el8+454+d7ef4b8d appstream 3.6 M 2023-07-20T14:58:37.326 INFO:teuthology.orchestra.run.smithi178.stdout: python3-podman noarch 4.5.1-1.module_el8+454+d7ef4b8d appstream 177 k 2023-07-20T14:58:37.326 INFO:teuthology.orchestra.run.smithi178.stdout: skopeo x86_64 2:1.12.0-2.module_el8+460+8cac93c8 appstream 8.3 M 2023-07-20T14:58:37.326 INFO:teuthology.orchestra.run.smithi178.stdout: toolbox x86_64 0.0.99.4-1.module_el8+454+d7ef4b8d appstream 2.5 M 2023-07-20T14:58:37.326 INFO:teuthology.orchestra.run.smithi178.stdout: udica noarch 0.2.6-4.module_el8+454+d7ef4b8d appstream 52 k 2023-07-20T14:58:37.326 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2023-07-20T14:58:37.326 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-07-20T14:58:37.327 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-07-20T14:58:37.327 INFO:teuthology.orchestra.run.smithi178.stdout: yajl x86_64 2.1.0-11.el8 appstream 41 k 2023-07-20T14:58:37.328 INFO:teuthology.orchestra.run.smithi178.stdout:Installing weak dependencies: 2023-07-20T14:58:37.328 INFO:teuthology.orchestra.run.smithi178.stdout: criu-libs x86_64 3.18-4.module_el8+454+d7ef4b8d appstream 39 k 2023-07-20T14:58:37.329 INFO:teuthology.orchestra.run.smithi178.stdout:Installing module profiles: 2023-07-20T14:58:37.329 INFO:teuthology.orchestra.run.smithi178.stdout: container-tools/common 2023-07-20T14:58:37.329 INFO:teuthology.orchestra.run.smithi178.stdout:Enabling module streams: 2023-07-20T14:58:37.329 INFO:teuthology.orchestra.run.smithi178.stdout: container-tools rhel8 2023-07-20T14:58:37.329 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-07-20T14:58:37.330 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-07-20T14:58:37.331 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================== 2023-07-20T14:58:37.331 INFO:teuthology.orchestra.run.smithi178.stdout:Install 13 Packages 2023-07-20T14:58:37.331 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrade 9 Packages 2023-07-20T14:58:37.331 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-07-20T14:58:37.331 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 51 M 2023-07-20T14:58:37.332 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-07-20T14:58:37.549 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-07-20T14:58:37.552 INFO:teuthology.orchestra.run.smithi029.stdout:=========================================================================================== 2023-07-20T14:58:37.553 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2023-07-20T14:58:37.553 INFO:teuthology.orchestra.run.smithi029.stdout:=========================================================================================== 2023-07-20T14:58:37.554 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrading: 2023-07-20T14:58:37.554 INFO:teuthology.orchestra.run.smithi029.stdout: conmon x86_64 3:2.1.7-1.module_el8+454+d7ef4b8d appstream 57 k 2023-07-20T14:58:37.555 INFO:teuthology.orchestra.run.smithi029.stdout: container-selinux noarch 2:2.218.0-1.module_el8+454+d7ef4b8d appstream 69 k 2023-07-20T14:58:37.555 INFO:teuthology.orchestra.run.smithi029.stdout: containernetworking-plugins x86_64 1:1.3.0-2.module_el8+461+0c6b54ea appstream 21 M 2023-07-20T14:58:37.555 INFO:teuthology.orchestra.run.smithi029.stdout: containers-common x86_64 2:1-51.module_el8+454+d7ef4b8d appstream 136 k 2023-07-20T14:58:37.556 INFO:teuthology.orchestra.run.smithi029.stdout: criu x86_64 3.18-4.module_el8+454+d7ef4b8d appstream 564 k 2023-07-20T14:58:37.565 INFO:teuthology.orchestra.run.smithi029.stdout: fuse-overlayfs x86_64 1.12-1.module_el8+454+d7ef4b8d appstream 70 k 2023-07-20T14:58:37.565 INFO:teuthology.orchestra.run.smithi029.stdout: libslirp x86_64 4.4.0-1.module_el8+454+d7ef4b8d appstream 70 k 2023-07-20T14:58:37.565 INFO:teuthology.orchestra.run.smithi029.stdout: runc x86_64 1:1.1.7-2.module_el8+463+b24391b1 appstream 3.1 M 2023-07-20T14:58:37.565 INFO:teuthology.orchestra.run.smithi029.stdout: slirp4netns x86_64 1.2.0-3.module_el8+454+d7ef4b8d appstream 54 k 2023-07-20T14:58:37.565 INFO:teuthology.orchestra.run.smithi029.stdout:Installing group/module packages: 2023-07-20T14:58:37.565 INFO:teuthology.orchestra.run.smithi029.stdout: aardvark-dns x86_64 2:1.6.0-1.module_el8+454+d7ef4b8d appstream 1.0 M 2023-07-20T14:58:37.566 INFO:teuthology.orchestra.run.smithi029.stdout: buildah x86_64 1:1.30.0-2.module_el8+460+8cac93c8 appstream 8.7 M 2023-07-20T14:58:37.566 INFO:teuthology.orchestra.run.smithi029.stdout: cockpit-podman noarch 70-1.module_el8+454+d7ef4b8d appstream 790 k 2023-07-20T14:58:37.566 INFO:teuthology.orchestra.run.smithi029.stdout: crun x86_64 1.8.5-1.module_el8+454+d7ef4b8d appstream 235 k 2023-07-20T14:58:37.566 INFO:teuthology.orchestra.run.smithi029.stdout: netavark x86_64 2:1.6.0-1.module_el8+454+d7ef4b8d appstream 3.6 M 2023-07-20T14:58:37.566 INFO:teuthology.orchestra.run.smithi029.stdout: python3-podman noarch 4.5.1-1.module_el8+454+d7ef4b8d appstream 177 k 2023-07-20T14:58:37.566 INFO:teuthology.orchestra.run.smithi029.stdout: skopeo x86_64 2:1.12.0-2.module_el8+460+8cac93c8 appstream 8.3 M 2023-07-20T14:58:37.566 INFO:teuthology.orchestra.run.smithi029.stdout: toolbox x86_64 0.0.99.4-1.module_el8+454+d7ef4b8d appstream 2.5 M 2023-07-20T14:58:37.566 INFO:teuthology.orchestra.run.smithi029.stdout: udica noarch 0.2.6-4.module_el8+454+d7ef4b8d appstream 52 k 2023-07-20T14:58:37.567 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2023-07-20T14:58:37.567 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-07-20T14:58:37.567 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-07-20T14:58:37.567 INFO:teuthology.orchestra.run.smithi029.stdout: yajl x86_64 2.1.0-11.el8 appstream 41 k 2023-07-20T14:58:37.567 INFO:teuthology.orchestra.run.smithi029.stdout:Installing weak dependencies: 2023-07-20T14:58:37.567 INFO:teuthology.orchestra.run.smithi029.stdout: criu-libs x86_64 3.18-4.module_el8+454+d7ef4b8d appstream 39 k 2023-07-20T14:58:37.567 INFO:teuthology.orchestra.run.smithi029.stdout:Installing module profiles: 2023-07-20T14:58:37.568 INFO:teuthology.orchestra.run.smithi029.stdout: container-tools/common 2023-07-20T14:58:37.568 INFO:teuthology.orchestra.run.smithi029.stdout:Enabling module streams: 2023-07-20T14:58:37.568 INFO:teuthology.orchestra.run.smithi029.stdout: container-tools rhel8 2023-07-20T14:58:37.581 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T14:58:37.581 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-07-20T14:58:37.582 INFO:teuthology.orchestra.run.smithi029.stdout:=========================================================================================== 2023-07-20T14:58:37.582 INFO:teuthology.orchestra.run.smithi029.stdout:Install 13 Packages 2023-07-20T14:58:37.582 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrade 9 Packages 2023-07-20T14:58:37.582 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T14:58:37.583 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 51 M 2023-07-20T14:58:37.583 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-07-20T14:58:37.761 INFO:teuthology.orchestra.run.smithi178.stdout:(1/22): cockpit-podman-70-1.module_el8+454+d7ef 2.0 MB/s | 790 kB 00:00 2023-07-20T14:58:37.826 INFO:teuthology.orchestra.run.smithi178.stdout:(2/22): criu-libs-3.18-4.module_el8+454+d7ef4b8 589 kB/s | 39 kB 00:00 2023-07-20T14:58:37.860 INFO:teuthology.orchestra.run.smithi178.stdout:(3/22): aardvark-dns-1.6.0-1.module_el8+454+d7e 2.0 MB/s | 1.0 MB 00:00 2023-07-20T14:58:37.905 INFO:teuthology.orchestra.run.smithi178.stdout:(4/22): crun-1.8.5-1.module_el8+454+d7ef4b8d.x8 3.1 MB/s | 235 kB 00:00 2023-07-20T14:58:37.977 INFO:teuthology.orchestra.run.smithi178.stdout:(5/22): python3-podman-4.5.1-1.module_el8+454+d 2.3 MB/s | 177 kB 00:00 2023-07-20T14:58:38.077 INFO:teuthology.orchestra.run.smithi178.stdout:(6/22): buildah-1.30.0-2.module_el8+460+8cac93c 12 MB/s | 8.7 MB 00:00 2023-07-20T14:58:38.103 INFO:teuthology.orchestra.run.smithi178.stdout:(7/22): python3-pytoml-0.1.14-5.git7dea353.el8. 198 kB/s | 25 kB 00:00 2023-07-20T14:58:38.144 INFO:teuthology.orchestra.run.smithi178.stdout:(8/22): python3-pyxdg-0.25-16.el8.noarch.rpm 1.4 MB/s | 94 kB 00:00 2023-07-20T14:58:38.427 INFO:teuthology.orchestra.run.smithi029.stdout:(1/22): cockpit-podman-70-1.module_el8+454+d7ef 1.1 MB/s | 790 kB 00:00 2023-07-20T14:58:38.493 INFO:teuthology.orchestra.run.smithi029.stdout:(2/22): criu-libs-3.18-4.module_el8+454+d7ef4b8 523 kB/s | 39 kB 00:00 2023-07-20T14:58:38.555 INFO:teuthology.orchestra.run.smithi029.stdout:(3/22): aardvark-dns-1.6.0-1.module_el8+454+d7e 1.2 MB/s | 1.0 MB 00:00 2023-07-20T14:58:38.555 INFO:teuthology.orchestra.run.smithi178.stdout:(9/22): toolbox-0.0.99.4-1.module_el8+454+d7ef4 6.2 MB/s | 2.5 MB 00:00 2023-07-20T14:58:38.631 INFO:teuthology.orchestra.run.smithi178.stdout:(10/22): netavark-1.6.0-1.module_el8+454+d7ef4b 4.7 MB/s | 3.6 MB 00:00 2023-07-20T14:58:38.656 INFO:teuthology.orchestra.run.smithi178.stdout:(11/22): udica-0.2.6-4.module_el8+454+d7ef4b8d. 525 kB/s | 52 kB 00:00 2023-07-20T14:58:38.666 INFO:teuthology.orchestra.run.smithi029.stdout:(4/22): crun-1.8.5-1.module_el8+454+d7ef4b8d.x8 1.4 MB/s | 235 kB 00:00 2023-07-20T14:58:38.753 INFO:teuthology.orchestra.run.smithi178.stdout:(12/22): skopeo-1.12.0-2.module_el8+460+8cac93c 13 MB/s | 8.3 MB 00:00 2023-07-20T14:58:38.773 INFO:teuthology.orchestra.run.smithi029.stdout:(5/22): python3-podman-4.5.1-1.module_el8+454+d 1.6 MB/s | 177 kB 00:00 2023-07-20T14:58:38.779 INFO:teuthology.orchestra.run.smithi178.stdout:(13/22): yajl-2.1.0-11.el8.x86_64.rpm 270 kB/s | 41 kB 00:00 2023-07-20T14:58:38.809 INFO:teuthology.orchestra.run.smithi178.stdout:(14/22): conmon-2.1.7-1.module_el8+454+d7ef4b8d 380 kB/s | 57 kB 00:00 2023-07-20T14:58:38.829 INFO:teuthology.orchestra.run.smithi178.stdout:(15/22): container-selinux-2.218.0-1.module_el8 920 kB/s | 69 kB 00:00 2023-07-20T14:58:38.840 INFO:teuthology.orchestra.run.smithi029.stdout:(6/22): python3-pytoml-0.1.14-5.git7dea353.el8. 370 kB/s | 25 kB 00:00 2023-07-20T14:58:38.868 INFO:teuthology.orchestra.run.smithi178.stdout:(16/22): containers-common-1-51.module_el8+454+ 2.3 MB/s | 136 kB 00:00 2023-07-20T14:58:38.914 INFO:teuthology.orchestra.run.smithi029.stdout:(7/22): python3-pyxdg-0.25-16.el8.noarch.rpm 1.2 MB/s | 94 kB 00:00 2023-07-20T14:58:38.938 INFO:teuthology.orchestra.run.smithi178.stdout:(17/22): criu-3.18-4.module_el8+454+d7ef4b8d.x8 5.1 MB/s | 564 kB 00:00 2023-07-20T14:58:38.963 INFO:teuthology.orchestra.run.smithi178.stdout:(18/22): fuse-overlayfs-1.12-1.module_el8+454+d 697 kB/s | 70 kB 00:00 2023-07-20T14:58:39.000 INFO:teuthology.orchestra.run.smithi178.stdout:(19/22): libslirp-4.4.0-1.module_el8+454+d7ef4b 1.2 MB/s | 70 kB 00:00 2023-07-20T14:58:39.073 INFO:teuthology.orchestra.run.smithi178.stdout:(20/22): slirp4netns-1.2.0-3.module_el8+454+d7e 725 kB/s | 54 kB 00:00 2023-07-20T14:58:39.288 INFO:teuthology.orchestra.run.smithi178.stdout:(21/22): runc-1.1.7-2.module_el8+463+b24391b1.x 9.7 MB/s | 3.1 MB 00:00 2023-07-20T14:58:39.628 INFO:teuthology.orchestra.run.smithi029.stdout:(8/22): netavark-1.6.0-1.module_el8+454+d7ef4b8 3.4 MB/s | 3.6 MB 00:01 2023-07-20T14:58:40.425 INFO:teuthology.orchestra.run.smithi029.stdout:(9/22): toolbox-0.0.99.4-1.module_el8+454+d7ef4 3.2 MB/s | 2.5 MB 00:00 2023-07-20T14:58:40.500 INFO:teuthology.orchestra.run.smithi029.stdout:(10/22): udica-0.2.6-4.module_el8+454+d7ef4b8d. 700 kB/s | 52 kB 00:00 2023-07-20T14:58:40.659 INFO:teuthology.orchestra.run.smithi029.stdout:(11/22): buildah-1.30.0-2.module_el8+460+8cac93 3.0 MB/s | 8.7 MB 00:02 2023-07-20T14:58:40.684 INFO:teuthology.orchestra.run.smithi029.stdout:(12/22): yajl-2.1.0-11.el8.x86_64.rpm 221 kB/s | 41 kB 00:00 2023-07-20T14:58:40.762 INFO:teuthology.orchestra.run.smithi029.stdout:(13/22): conmon-2.1.7-1.module_el8+454+d7ef4b8d 569 kB/s | 57 kB 00:00 2023-07-20T14:58:40.787 INFO:teuthology.orchestra.run.smithi029.stdout:(14/22): container-selinux-2.218.0-1.module_el8 688 kB/s | 69 kB 00:00 2023-07-20T14:58:40.900 INFO:teuthology.orchestra.run.smithi029.stdout:(15/22): containers-common-1-51.module_el8+454+ 1.3 MB/s | 136 kB 00:00 2023-07-20T14:58:40.998 INFO:teuthology.orchestra.run.smithi178.stdout:(22/22): containernetworking-plugins-1.3.0-2.mo 9.7 MB/s | 21 MB 00:02 2023-07-20T14:58:40.999 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-07-20T14:58:40.999 INFO:teuthology.orchestra.run.smithi178.stdout:Total 14 MB/s | 51 MB 00:03 2023-07-20T14:58:41.125 INFO:teuthology.orchestra.run.smithi029.stdout:(16/22): criu-3.18-4.module_el8+454+d7ef4b8d.x8 2.4 MB/s | 564 kB 00:00 2023-07-20T14:58:41.183 INFO:teuthology.orchestra.run.smithi029.stdout:(17/22): fuse-overlayfs-1.12-1.module_el8+454+d 1.2 MB/s | 70 kB 00:00 2023-07-20T14:58:41.246 INFO:teuthology.orchestra.run.smithi029.stdout:(18/22): libslirp-4.4.0-1.module_el8+454+d7ef4b 1.0 MB/s | 70 kB 00:00 2023-07-20T14:58:41.482 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-07-20T14:58:41.538 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-07-20T14:58:41.538 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-07-20T14:58:41.804 INFO:teuthology.orchestra.run.smithi029.stdout:(19/22): skopeo-1.12.0-2.module_el8+460+8cac93c 2.9 MB/s | 8.3 MB 00:02 2023-07-20T14:58:41.866 INFO:teuthology.orchestra.run.smithi029.stdout:(20/22): slirp4netns-1.2.0-3.module_el8+454+d7e 814 kB/s | 54 kB 00:00 2023-07-20T14:58:42.038 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-07-20T14:58:42.046 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-07-20T14:58:42.184 INFO:teuthology.orchestra.run.smithi029.stdout:(21/22): runc-1.1.7-2.module_el8+463+b24391b1.x 3.3 MB/s | 3.1 MB 00:00 2023-07-20T14:58:43.331 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-07-20T14:58:43.415 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: criu-3.18-4.module_el8+454+d7ef4b8d.x86_64 1/1 2023-07-20T14:58:43.617 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : criu-3.18-4.module_el8+454+d7ef4b8d.x86_64 1/31 2023-07-20T14:58:43.644 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: container-selinux-2:2.218.0-1.module_el8+454+d7ef4 2/31 2023-07-20T14:58:43.867 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : container-selinux-2:2.218.0-1.module_el8+454+d7ef4 2/31 2023-07-20T14:58:45.366 INFO:teuthology.orchestra.run.smithi029.stdout:(22/22): containernetworking-plugins-1.3.0-2.mo 4.6 MB/s | 21 MB 00:04 2023-07-20T14:58:45.367 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-07-20T14:58:45.367 INFO:teuthology.orchestra.run.smithi029.stdout:Total 6.5 MB/s | 51 MB 00:07 2023-07-20T14:58:45.876 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-07-20T14:58:45.928 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-07-20T14:58:45.928 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-07-20T14:58:46.420 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-07-20T14:58:46.422 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-07-20T14:58:47.708 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-07-20T14:58:47.808 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: criu-3.18-4.module_el8+454+d7ef4b8d.x86_64 1/1 2023-07-20T14:58:48.028 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : criu-3.18-4.module_el8+454+d7ef4b8d.x86_64 1/31 2023-07-20T14:58:48.064 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: container-selinux-2:2.218.0-1.module_el8+454+d7ef4 2/31 2023-07-20T14:58:48.307 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : container-selinux-2:2.218.0-1.module_el8+454+d7ef4 2/31 2023-07-20T14:59:01.513 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: container-selinux-2:2.218.0-1.module_el8+454+d7ef4 2/31 2023-07-20T14:59:01.771 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : runc-1:1.1.7-2.module_el8+463+b24391b1.x86_64 3/31 2023-07-20T14:59:01.929 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : criu-libs-3.18-4.module_el8+454+d7ef4b8d.x86_64 4/31 2023-07-20T14:59:02.167 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : libslirp-4.4.0-1.module_el8+454+d7ef4b8d.x86_64 5/31 2023-07-20T14:59:02.411 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : slirp4netns-1.2.0-3.module_el8+454+d7ef4b8d.x86_64 6/31 2023-07-20T14:59:02.589 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : fuse-overlayfs-1.12-1.module_el8+454+d7ef4b8d.x86_ 7/31 2023-07-20T14:59:04.375 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: fuse-overlayfs-1.12-1.module_el8+454+d7ef4b8d.x86_ 7/31 2023-07-20T14:59:04.613 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : containernetworking-plugins-1:1.3.0-2.module_el8+4 8/31 2023-07-20T14:59:04.800 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : yajl-2.1.0-11.el8.x86_64 9/31 2023-07-20T14:59:05.024 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : crun-1.8.5-1.module_el8+454+d7ef4b8d.x86_64 10/31 2023-07-20T14:59:05.279 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : containers-common-2:1-51.module_el8+454+d7ef4b8d.x 11/31 2023-07-20T14:59:05.451 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 12/31 2023-07-20T14:59:05.756 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 13/31 2023-07-20T14:59:06.329 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : aardvark-dns-2:1.6.0-1.module_el8+454+d7ef4b8d.x86 14/31 2023-07-20T14:59:07.227 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : netavark-2:1.6.0-1.module_el8+454+d7ef4b8d.x86_64 15/31 2023-07-20T14:59:07.330 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: container-selinux-2:2.218.0-1.module_el8+454+d7ef4 2/31 2023-07-20T14:59:07.528 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : buildah-1:1.30.0-2.module_el8+460+8cac93c8.x86_64 16/31 2023-07-20T14:59:07.575 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : runc-1:1.1.7-2.module_el8+463+b24391b1.x86_64 3/31 2023-07-20T14:59:07.741 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : criu-libs-3.18-4.module_el8+454+d7ef4b8d.x86_64 4/31 2023-07-20T14:59:07.938 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : libslirp-4.4.0-1.module_el8+454+d7ef4b8d.x86_64 5/31 2023-07-20T14:59:08.212 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : slirp4netns-1.2.0-3.module_el8+454+d7ef4b8d.x86_64 6/31 2023-07-20T14:59:08.381 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : fuse-overlayfs-1.12-1.module_el8+454+d7ef4b8d.x86_ 7/31 2023-07-20T14:59:08.486 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-podman-4.5.1-1.module_el8+454+d7ef4b8d.noa 17/31 2023-07-20T14:59:08.868 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : skopeo-2:1.12.0-2.module_el8+460+8cac93c8.x86_64 18/31 2023-07-20T14:59:09.093 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : toolbox-0.0.99.4-1.module_el8+454+d7ef4b8d.x86_64 19/31 2023-07-20T14:59:09.300 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : udica-0.2.6-4.module_el8+454+d7ef4b8d.noarch 20/31 2023-07-20T14:59:09.568 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : conmon-3:2.1.7-1.module_el8+454+d7ef4b8d.x86_64 21/31 2023-07-20T14:59:09.716 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cockpit-podman-70-1.module_el8+454+d7ef4b8d.noarch 22/31 2023-07-20T14:59:09.930 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : containers-common-2:1-49.module_el8.8.0+1254+78119 23/31 2023-07-20T14:59:10.110 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 24/31 2023-07-20T14:59:10.310 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: fuse-overlayfs-1.12-1.module_el8+454+d7ef4b8d.x86_ 7/31 2023-07-20T14:59:10.338 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 25/31 2023-07-20T14:59:10.338 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 26/31 2023-07-20T14:59:10.514 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : containernetworking-plugins-1:1.3.0-2.module_el8+4 8/31 2023-07-20T14:59:10.565 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 26/31 2023-07-20T14:59:10.744 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : yajl-2.1.0-11.el8.x86_64 9/31 2023-07-20T14:59:10.835 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 27/31 2023-07-20T14:59:10.965 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : crun-1.8.5-1.module_el8+454+d7ef4b8d.x86_64 10/31 2023-07-20T14:59:11.040 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 28/31 2023-07-20T14:59:11.241 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : containers-common-2:1-51.module_el8+454+d7ef4b8d.x 11/31 2023-07-20T14:59:11.241 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : fuse-overlayfs-1.10-1.module_el8.8.0+1254+78119b6e 29/31 2023-07-20T14:59:11.420 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 12/31 2023-07-20T14:59:11.481 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : containernetworking-plugins-1:1.1.1-3.module_el8.7 30/31 2023-07-20T14:59:11.689 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 31/31 2023-07-20T14:59:11.799 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 13/31 2023-07-20T14:59:12.142 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: container-selinux-2:2.218.0-1.module_el8+454+d7ef4 31/31 2023-07-20T14:59:12.357 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : aardvark-dns-2:1.6.0-1.module_el8+454+d7ef4b8d.x86 14/31 2023-07-20T14:59:12.598 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 31/31 2023-07-20T14:59:12.598 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : aardvark-dns-2:1.6.0-1.module_el8+454+d7ef4b8d.x86 1/31 2023-07-20T14:59:12.598 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : buildah-1:1.30.0-2.module_el8+460+8cac93c8.x86_64 2/31 2023-07-20T14:59:12.598 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cockpit-podman-70-1.module_el8+454+d7ef4b8d.noarch 3/31 2023-07-20T14:59:12.598 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : criu-libs-3.18-4.module_el8+454+d7ef4b8d.x86_64 4/31 2023-07-20T14:59:12.599 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : crun-1.8.5-1.module_el8+454+d7ef4b8d.x86_64 5/31 2023-07-20T14:59:12.599 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : netavark-2:1.6.0-1.module_el8+454+d7ef4b8d.x86_64 6/31 2023-07-20T14:59:12.599 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-podman-4.5.1-1.module_el8+454+d7ef4b8d.noa 7/31 2023-07-20T14:59:12.606 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/31 2023-07-20T14:59:12.606 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/31 2023-07-20T14:59:12.606 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : skopeo-2:1.12.0-2.module_el8+460+8cac93c8.x86_64 10/31 2023-07-20T14:59:12.607 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : toolbox-0.0.99.4-1.module_el8+454+d7ef4b8d.x86_64 11/31 2023-07-20T14:59:12.607 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : udica-0.2.6-4.module_el8+454+d7ef4b8d.noarch 12/31 2023-07-20T14:59:12.607 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : yajl-2.1.0-11.el8.x86_64 13/31 2023-07-20T14:59:12.607 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : conmon-3:2.1.7-1.module_el8+454+d7ef4b8d.x86_64 14/31 2023-07-20T14:59:12.608 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 15/31 2023-07-20T14:59:12.608 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : container-selinux-2:2.218.0-1.module_el8+454+d7ef4 16/31 2023-07-20T14:59:12.608 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 17/31 2023-07-20T14:59:12.608 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : containernetworking-plugins-1:1.3.0-2.module_el8+4 18/31 2023-07-20T14:59:12.608 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module_el8.7 19/31 2023-07-20T14:59:12.608 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : containers-common-2:1-51.module_el8+454+d7ef4b8d.x 20/31 2023-07-20T14:59:12.608 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : containers-common-2:1-49.module_el8.8.0+1254+78119 21/31 2023-07-20T14:59:12.609 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : criu-3.18-4.module_el8+454+d7ef4b8d.x86_64 22/31 2023-07-20T14:59:12.609 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 23/31 2023-07-20T14:59:12.609 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : fuse-overlayfs-1.12-1.module_el8+454+d7ef4b8d.x86_ 24/31 2023-07-20T14:59:12.609 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : fuse-overlayfs-1.10-1.module_el8.8.0+1254+78119b6e 25/31 2023-07-20T14:59:12.609 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libslirp-4.4.0-1.module_el8+454+d7ef4b8d.x86_64 26/31 2023-07-20T14:59:12.609 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 27/31 2023-07-20T14:59:12.609 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : runc-1:1.1.7-2.module_el8+463+b24391b1.x86_64 28/31 2023-07-20T14:59:12.609 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 29/31 2023-07-20T14:59:12.610 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : slirp4netns-1.2.0-3.module_el8+454+d7ef4b8d.x86_64 30/31 2023-07-20T14:59:13.330 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : netavark-2:1.6.0-1.module_el8+454+d7ef4b8d.x86_64 15/31 2023-07-20T14:59:13.545 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 31/31 2023-07-20T14:59:13.553 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-07-20T14:59:13.553 INFO:teuthology.orchestra.run.smithi178.stdout:Upgraded: 2023-07-20T14:59:13.557 INFO:teuthology.orchestra.run.smithi178.stdout: conmon-3:2.1.7-1.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:13.562 INFO:teuthology.orchestra.run.smithi178.stdout: container-selinux-2:2.218.0-1.module_el8+454+d7ef4b8d.noarch 2023-07-20T14:59:13.565 INFO:teuthology.orchestra.run.smithi178.stdout: containernetworking-plugins-1:1.3.0-2.module_el8+461+0c6b54ea.x86_64 2023-07-20T14:59:13.566 INFO:teuthology.orchestra.run.smithi178.stdout: containers-common-2:1-51.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:13.566 INFO:teuthology.orchestra.run.smithi178.stdout: criu-3.18-4.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:13.572 INFO:teuthology.orchestra.run.smithi178.stdout: fuse-overlayfs-1.12-1.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:13.572 INFO:teuthology.orchestra.run.smithi178.stdout: libslirp-4.4.0-1.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:13.573 INFO:teuthology.orchestra.run.smithi178.stdout: runc-1:1.1.7-2.module_el8+463+b24391b1.x86_64 2023-07-20T14:59:13.577 INFO:teuthology.orchestra.run.smithi178.stdout: slirp4netns-1.2.0-3.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:13.577 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-07-20T14:59:13.577 INFO:teuthology.orchestra.run.smithi178.stdout: aardvark-dns-2:1.6.0-1.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:13.577 INFO:teuthology.orchestra.run.smithi178.stdout: buildah-1:1.30.0-2.module_el8+460+8cac93c8.x86_64 2023-07-20T14:59:13.578 INFO:teuthology.orchestra.run.smithi178.stdout: cockpit-podman-70-1.module_el8+454+d7ef4b8d.noarch 2023-07-20T14:59:13.602 INFO:teuthology.orchestra.run.smithi178.stdout: criu-libs-3.18-4.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:13.602 INFO:teuthology.orchestra.run.smithi178.stdout: crun-1.8.5-1.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:13.602 INFO:teuthology.orchestra.run.smithi178.stdout: netavark-2:1.6.0-1.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:13.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-podman-4.5.1-1.module_el8+454+d7ef4b8d.noarch 2023-07-20T14:59:13.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-07-20T14:59:13.603 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-07-20T14:59:13.603 INFO:teuthology.orchestra.run.smithi178.stdout: skopeo-2:1.12.0-2.module_el8+460+8cac93c8.x86_64 2023-07-20T14:59:13.603 INFO:teuthology.orchestra.run.smithi178.stdout: toolbox-0.0.99.4-1.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:13.603 INFO:teuthology.orchestra.run.smithi178.stdout: udica-0.2.6-4.module_el8+454+d7ef4b8d.noarch 2023-07-20T14:59:13.603 INFO:teuthology.orchestra.run.smithi178.stdout: yajl-2.1.0-11.el8.x86_64 2023-07-20T14:59:13.603 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-07-20T14:59:13.603 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-07-20T14:59:13.644 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : buildah-1:1.30.0-2.module_el8+460+8cac93c8.x86_64 16/31 2023-07-20T14:59:13.860 DEBUG:teuthology.parallel:result is None 2023-07-20T14:59:14.644 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-podman-4.5.1-1.module_el8+454+d7ef4b8d.noa 17/31 2023-07-20T14:59:15.068 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : skopeo-2:1.12.0-2.module_el8+460+8cac93c8.x86_64 18/31 2023-07-20T14:59:15.274 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : toolbox-0.0.99.4-1.module_el8+454+d7ef4b8d.x86_64 19/31 2023-07-20T14:59:15.500 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : udica-0.2.6-4.module_el8+454+d7ef4b8d.noarch 20/31 2023-07-20T14:59:15.777 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : conmon-3:2.1.7-1.module_el8+454+d7ef4b8d.x86_64 21/31 2023-07-20T14:59:16.004 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cockpit-podman-70-1.module_el8+454+d7ef4b8d.noarch 22/31 2023-07-20T14:59:16.197 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : containers-common-2:1-49.module_el8.8.0+1254+78119 23/31 2023-07-20T14:59:16.462 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 24/31 2023-07-20T14:59:16.614 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 25/31 2023-07-20T14:59:16.614 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 26/31 2023-07-20T14:59:16.850 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 26/31 2023-07-20T14:59:17.073 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 27/31 2023-07-20T14:59:17.244 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 28/31 2023-07-20T14:59:17.469 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : fuse-overlayfs-1.10-1.module_el8.8.0+1254+78119b6e 29/31 2023-07-20T14:59:17.661 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : containernetworking-plugins-1:1.1.1-3.module_el8.7 30/31 2023-07-20T14:59:17.875 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 31/31 2023-07-20T14:59:18.369 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: container-selinux-2:2.218.0-1.module_el8+454+d7ef4 31/31 2023-07-20T14:59:18.810 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 31/31 2023-07-20T14:59:18.810 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : aardvark-dns-2:1.6.0-1.module_el8+454+d7ef4b8d.x86 1/31 2023-07-20T14:59:18.810 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : buildah-1:1.30.0-2.module_el8+460+8cac93c8.x86_64 2/31 2023-07-20T14:59:18.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cockpit-podman-70-1.module_el8+454+d7ef4b8d.noarch 3/31 2023-07-20T14:59:18.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : criu-libs-3.18-4.module_el8+454+d7ef4b8d.x86_64 4/31 2023-07-20T14:59:18.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : crun-1.8.5-1.module_el8+454+d7ef4b8d.x86_64 5/31 2023-07-20T14:59:18.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : netavark-2:1.6.0-1.module_el8+454+d7ef4b8d.x86_64 6/31 2023-07-20T14:59:18.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-podman-4.5.1-1.module_el8+454+d7ef4b8d.noa 7/31 2023-07-20T14:59:18.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/31 2023-07-20T14:59:18.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/31 2023-07-20T14:59:18.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : skopeo-2:1.12.0-2.module_el8+460+8cac93c8.x86_64 10/31 2023-07-20T14:59:18.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : toolbox-0.0.99.4-1.module_el8+454+d7ef4b8d.x86_64 11/31 2023-07-20T14:59:18.849 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : udica-0.2.6-4.module_el8+454+d7ef4b8d.noarch 12/31 2023-07-20T14:59:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : yajl-2.1.0-11.el8.x86_64 13/31 2023-07-20T14:59:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : conmon-3:2.1.7-1.module_el8+454+d7ef4b8d.x86_64 14/31 2023-07-20T14:59:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 15/31 2023-07-20T14:59:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : container-selinux-2:2.218.0-1.module_el8+454+d7ef4 16/31 2023-07-20T14:59:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 17/31 2023-07-20T14:59:18.852 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : containernetworking-plugins-1:1.3.0-2.module_el8+4 18/31 2023-07-20T14:59:18.852 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module_el8.7 19/31 2023-07-20T14:59:18.852 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : containers-common-2:1-51.module_el8+454+d7ef4b8d.x 20/31 2023-07-20T14:59:18.852 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : containers-common-2:1-49.module_el8.8.0+1254+78119 21/31 2023-07-20T14:59:18.852 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : criu-3.18-4.module_el8+454+d7ef4b8d.x86_64 22/31 2023-07-20T14:59:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 23/31 2023-07-20T14:59:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fuse-overlayfs-1.12-1.module_el8+454+d7ef4b8d.x86_ 24/31 2023-07-20T14:59:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fuse-overlayfs-1.10-1.module_el8.8.0+1254+78119b6e 25/31 2023-07-20T14:59:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libslirp-4.4.0-1.module_el8+454+d7ef4b8d.x86_64 26/31 2023-07-20T14:59:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 27/31 2023-07-20T14:59:18.854 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : runc-1:1.1.7-2.module_el8+463+b24391b1.x86_64 28/31 2023-07-20T14:59:18.854 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 29/31 2023-07-20T14:59:18.854 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : slirp4netns-1.2.0-3.module_el8+454+d7ef4b8d.x86_64 30/31 2023-07-20T14:59:19.718 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 31/31 2023-07-20T14:59:19.719 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T14:59:19.719 INFO:teuthology.orchestra.run.smithi029.stdout:Upgraded: 2023-07-20T14:59:19.719 INFO:teuthology.orchestra.run.smithi029.stdout: conmon-3:2.1.7-1.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:19.719 INFO:teuthology.orchestra.run.smithi029.stdout: container-selinux-2:2.218.0-1.module_el8+454+d7ef4b8d.noarch 2023-07-20T14:59:19.719 INFO:teuthology.orchestra.run.smithi029.stdout: containernetworking-plugins-1:1.3.0-2.module_el8+461+0c6b54ea.x86_64 2023-07-20T14:59:19.720 INFO:teuthology.orchestra.run.smithi029.stdout: containers-common-2:1-51.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:19.720 INFO:teuthology.orchestra.run.smithi029.stdout: criu-3.18-4.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:19.736 INFO:teuthology.orchestra.run.smithi029.stdout: fuse-overlayfs-1.12-1.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:19.736 INFO:teuthology.orchestra.run.smithi029.stdout: libslirp-4.4.0-1.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:19.737 INFO:teuthology.orchestra.run.smithi029.stdout: runc-1:1.1.7-2.module_el8+463+b24391b1.x86_64 2023-07-20T14:59:19.743 INFO:teuthology.orchestra.run.smithi029.stdout: slirp4netns-1.2.0-3.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:19.749 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-07-20T14:59:19.749 INFO:teuthology.orchestra.run.smithi029.stdout: aardvark-dns-2:1.6.0-1.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:19.749 INFO:teuthology.orchestra.run.smithi029.stdout: buildah-1:1.30.0-2.module_el8+460+8cac93c8.x86_64 2023-07-20T14:59:19.749 INFO:teuthology.orchestra.run.smithi029.stdout: cockpit-podman-70-1.module_el8+454+d7ef4b8d.noarch 2023-07-20T14:59:19.751 INFO:teuthology.orchestra.run.smithi029.stdout: criu-libs-3.18-4.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:19.752 INFO:teuthology.orchestra.run.smithi029.stdout: crun-1.8.5-1.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:19.775 INFO:teuthology.orchestra.run.smithi029.stdout: netavark-2:1.6.0-1.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:19.777 INFO:teuthology.orchestra.run.smithi029.stdout: python3-podman-4.5.1-1.module_el8+454+d7ef4b8d.noarch 2023-07-20T14:59:19.777 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-07-20T14:59:19.778 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-07-20T14:59:19.778 INFO:teuthology.orchestra.run.smithi029.stdout: skopeo-2:1.12.0-2.module_el8+460+8cac93c8.x86_64 2023-07-20T14:59:19.778 INFO:teuthology.orchestra.run.smithi029.stdout: toolbox-0.0.99.4-1.module_el8+454+d7ef4b8d.x86_64 2023-07-20T14:59:19.778 INFO:teuthology.orchestra.run.smithi029.stdout: udica-0.2.6-4.module_el8+454+d7ef4b8d.noarch 2023-07-20T14:59:19.778 INFO:teuthology.orchestra.run.smithi029.stdout: yajl-2.1.0-11.el8.x86_64 2023-07-20T14:59:19.778 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T14:59:19.778 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-07-20T14:59:20.023 DEBUG:teuthology.parallel:result is None 2023-07-20T14:59:20.023 INFO:teuthology.run_tasks:Running task cephadm... 2023-07-20T14:59:21.206 INFO:tasks.cephadm:Config: {'add_mons_via_daemon_add': True, 'allow_ptrace': False, 'avoid_pacific_features': True, 'cephadm_branch': 'v15.2.0', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v15.2.0', 'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'e20180733e4b085d1abe55675eb8c828b0bfedec'} 2023-07-20T14:59:21.208 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v15.2.0 2023-07-20T14:59:21.355 INFO:tasks.cephadm:Cluster fsid is 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T14:59:21.356 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-07-20T14:59:21.378 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.29', 'mon.c': '[v2:172.21.15.29:3301,v1:172.21.15.29:6790]', 'mon.b': '172.21.15.178'} 2023-07-20T14:59:21.379 INFO:tasks.cephadm:First mon is mon.a on smithi029 2023-07-20T14:59:21.379 INFO:tasks.cephadm:First mgr is y 2023-07-20T14:59:21.379 INFO:tasks.cephadm:Normalizing hostnames... 2023-07-20T14:59:21.380 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname $(hostname -s) 2023-07-20T14:59:21.424 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname $(hostname -s) 2023-07-20T14:59:21.499 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v15.2.0)... 2023-07-20T14:59:21.522 DEBUG:teuthology.orchestra.run.smithi029:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-07-20T14:59:21.792 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-rw-r--. 1 ubuntu ubuntu 151122 Jul 20 14:59 /home/ubuntu/cephtest/cephadm 2023-07-20T14:59:21.853 DEBUG:teuthology.orchestra.run.smithi178:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-07-20T14:59:22.058 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-rw-r--. 1 ubuntu ubuntu 151122 Jul 20 14:59 /home/ubuntu/cephtest/cephadm 2023-07-20T14:59:22.070 DEBUG:teuthology.orchestra.run.smithi029:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-07-20T14:59:22.095 DEBUG:teuthology.orchestra.run.smithi178:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-07-20T14:59:22.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph 2023-07-20T14:59:22.416 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph 2023-07-20T14:59:22.508 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /etc/ceph 2023-07-20T14:59:22.549 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /etc/ceph 2023-07-20T14:59:22.619 INFO:tasks.cephadm:Writing seed config... 2023-07-20T14:59:22.620 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2023-07-20T14:59:22.620 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-07-20T14:59:22.648 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-07-20T14:59:22.649 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-07-20T14:59:22.649 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-07-20T14:59:22.649 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-07-20T14:59:22.650 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-07-20T14:59:22.650 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-07-20T14:59:22.650 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-07-20T14:59:22.651 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-07-20T14:59:22.691 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 021c9860-270e-11ee-9b34-001a4aab830c mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2023-07-20T14:59:22.695 DEBUG:teuthology.orchestra.run.smithi029:mon.a> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.a.service 2023-07-20T14:59:22.738 DEBUG:teuthology.orchestra.run.smithi029:mgr.y> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.y.service 2023-07-20T14:59:22.772 INFO:journalctl@ceph.mon.a.smithi029.stdout:-- Logs begin at Thu 2023-07-20 14:49:36 UTC. -- 2023-07-20T14:59:22.773 INFO:tasks.cephadm:Bootstrapping... 2023-07-20T14:59:22.774 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 -v bootstrap --fsid 021c9860-270e-11ee-9b34-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.29 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-07-20T14:59:22.862 INFO:journalctl@ceph.mgr.y.smithi029.stdout:-- Logs begin at Thu 2023-07-20 14:49:36 UTC. -- 2023-07-20T14:59:22.929 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Verifying podman|docker is present... 2023-07-20T14:59:22.930 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Verifying lvm2 is present... 2023-07-20T14:59:22.930 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Verifying time synchronization is in place... 2023-07-20T14:59:22.930 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2023-07-20T14:59:22.962 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2023-07-20T14:59:22.963 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2023-07-20T14:59:22.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stdout inactive 2023-07-20T14:59:22.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2023-07-20T14:59:22.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stdout enabled 2023-07-20T14:59:22.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2023-07-20T14:59:22.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stdout active 2023-07-20T14:59:23.003 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Unit chronyd.service is enabled and running 2023-07-20T14:59:23.003 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Repeating the final host check... 2023-07-20T14:59:23.004 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:podman|docker (/bin/podman) is present 2023-07-20T14:59:23.004 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:systemctl is present 2023-07-20T14:59:23.004 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:lvcreate is present 2023-07-20T14:59:23.004 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2023-07-20T14:59:23.059 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2023-07-20T14:59:23.059 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2023-07-20T14:59:23.059 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stdout inactive 2023-07-20T14:59:23.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2023-07-20T14:59:23.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stdout enabled 2023-07-20T14:59:23.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2023-07-20T14:59:23.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stdout active 2023-07-20T14:59:23.072 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Unit chronyd.service is enabled and running 2023-07-20T14:59:23.072 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Host looks OK 2023-07-20T14:59:23.114 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:root:Cluster fsid: 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T14:59:23.115 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Acquiring lock 139719303125144 on /run/cephadm/021c9860-270e-11ee-9b34-001a4aab830c.lock 2023-07-20T14:59:23.115 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Lock 139719303125144 acquired on /run/cephadm/021c9860-270e-11ee-9b34-001a4aab830c.lock 2023-07-20T14:59:23.115 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Verifying IP 172.21.15.29 port 3300 ... 2023-07-20T14:59:23.115 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Verifying IP 172.21.15.29 port 6789 ... 2023-07-20T14:59:23.115 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Base mon IP is 172.21.15.29, final addrv is [v2:172.21.15.29:3300,v1:172.21.15.29:6789] 2023-07-20T14:59:23.116 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /sbin/ip route ls 2023-07-20T14:59:23.167 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/sbin/ip:stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.29 metric 100 2023-07-20T14:59:23.167 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/sbin/ip:stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.29 metric 100 2023-07-20T14:59:23.167 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Mon IP 172.21.15.29 is in CIDR network 172.21.0.0/20 2023-07-20T14:59:23.167 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Pulling latest docker.io/ceph/ceph:v15.2.0 container... 2023-07-20T14:59:23.167 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman pull docker.io/ceph/ceph:v15.2.0 2023-07-20T14:59:25.404 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/bin/podman:stderr Trying to pull docker.io/ceph/ceph:v15.2.0... 2023-07-20T14:59:25.868 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/bin/podman:stderr Getting image source signatures 2023-07-20T14:59:25.869 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:120f0bd0d532e2094e4c344cda2d32931787ee8c2e5d6b9ddd4698dfe3ef6110 2023-07-20T14:59:25.869 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:8a29a15cefaeccf6545f7ecf11298f9672d2f0cdaf9e357a95133ac3ad3e1f07 2023-07-20T14:59:36.454 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/bin/podman:stderr Copying config sha256:204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1 2023-07-20T14:59:36.512 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/bin/podman:stderr Writing manifest to image destination 2023-07-20T14:59:36.512 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/bin/podman:stderr Storing signatures 2023-07-20T14:59:36.882 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/bin/podman:stdout 204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1 2023-07-20T14:59:36.893 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Extracting ceph user uid/gid from container image... 2023-07-20T14:59:36.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '--entrypoint', 'stat', 'docker.io/ceph/ceph:v15.2.0', '-c', '%u %g', '/var/lib/ceph'] 2023-07-20T14:59:36.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 --entrypoint stat docker.io/ceph/ceph:v15.2.0 -c %u %g /var/lib/ceph 2023-07-20T14:59:37.299 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:stat:stdout 167 167 2023-07-20T14:59:37.610 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Creating initial keys... 2023-07-20T14:59:37.610 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2023-07-20T14:59:37.611 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2023-07-20T14:59:37.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQDZS7lkUj0RMhAA4djkF9mGtks2s/pjjuCNtQ== 2023-07-20T14:59:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2023-07-20T14:59:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2023-07-20T14:59:38.527 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQDaS7lk4PzjGxAAXZ8NZgiZfKThHkgqMDLcbw== 2023-07-20T14:59:38.865 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2023-07-20T14:59:38.865 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2023-07-20T14:59:39.120 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQDbS7lkW8oJBBAACw/Ar9m6vetc4fXrFeV52g== 2023-07-20T14:59:39.458 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Creating initial monmap... 2023-07-20T14:59:39.458 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/tmp/ceph-tmpb5wd_izo:/tmp/monmap:z', '--entrypoint', '/usr/bin/monmaptool', 'docker.io/ceph/ceph:v15.2.0', '--create', '--clobber', '--fsid', '021c9860-270e-11ee-9b34-001a4aab830c', '--addv', 'a', '[v2:172.21.15.29:3300,v1:172.21.15.29:6789]', '/tmp/monmap'] 2023-07-20T14:59:39.458 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /tmp/ceph-tmpb5wd_izo:/tmp/monmap:z --entrypoint /usr/bin/monmaptool docker.io/ceph/ceph:v15.2.0 --create --clobber --fsid 021c9860-270e-11ee-9b34-001a4aab830c --addv a [v2:172.21.15.29:3300,v1:172.21.15.29:6789] /tmp/monmap 2023-07-20T14:59:39.712 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-07-20T14:59:39.713 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: set fsid to 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T14:59:39.713 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-07-20T14:59:40.070 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Creating mon... 2023-07-20T14:59:40.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '-v', '/tmp/ceph-tmpfrdo5l3r:/tmp/keyring:z', '-v', '/tmp/ceph-tmpb5wd_izo:/tmp/monmap:z', '--entrypoint', '/usr/bin/ceph-mon', 'docker.io/ceph/ceph:v15.2.0', '--mkfs', '-i', 'a', '--fsid', '021c9860-270e-11ee-9b34-001a4aab830c', '-c', '/dev/null', '--monmap', '/tmp/monmap', '--keyring', '/tmp/keyring', '--setuser', 'ceph', '--setgroup', 'ceph', '--default-log-to-file=false', '--default-log-to-stderr=true', '--default-log-stderr-prefix="debug "', '--default-mon-cluster-log-to-file=false', '--default-mon-cluster-log-to-stderr=true'] 2023-07-20T14:59:40.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpfrdo5l3r:/tmp/keyring:z -v /tmp/ceph-tmpb5wd_izo:/tmp/monmap:z --entrypoint /usr/bin/ceph-mon docker.io/ceph/ceph:v15.2.0 --mkfs -i a --fsid 021c9860-270e-11ee-9b34-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2023-07-20T14:59:40.510 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.289+0000 7f0b51adb6c0 0 set uid:gid to 167:167 (ceph:ceph) 2023-07-20T14:59:40.516 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.289+0000 7f0b51adb6c0 1 imported monmap: 2023-07-20T14:59:40.516 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr epoch 0 2023-07-20T14:59:40.519 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr fsid 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T14:59:40.541 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr last_changed 2023-07-20T14:59:39.669074+0000 2023-07-20T14:59:40.541 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr created 2023-07-20T14:59:39.669074+0000 2023-07-20T14:59:40.542 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr min_mon_release 0 (unknown) 2023-07-20T14:59:40.542 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2023-07-20T14:59:40.542 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.542 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.289+0000 7f0b51adb6c0 0 /usr/bin/ceph-mon: set fsid to 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T14:59:40.542 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.289+0000 7f0b51adb6c0 0 set rocksdb option compression = kNoCompression 2023-07-20T14:59:40.542 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.289+0000 7f0b51adb6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2023-07-20T14:59:40.542 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.289+0000 7f0b51adb6c0 0 set rocksdb option write_buffer_size = 33554432 2023-07-20T14:59:40.543 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.289+0000 7f0b51adb6c0 0 set rocksdb option compression = kNoCompression 2023-07-20T14:59:40.543 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.289+0000 7f0b51adb6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2023-07-20T14:59:40.543 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.289+0000 7f0b51adb6c0 0 set rocksdb option write_buffer_size = 33554432 2023-07-20T14:59:40.543 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: RocksDB version: 6.1.2 2023-07-20T14:59:40.595 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.595 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-07-20T14:59:40.595 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Compile date Mar 23 2020 2023-07-20T14:59:40.597 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: DB SUMMARY 2023-07-20T14:59:40.598 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.598 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2023-07-20T14:59:40.598 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.598 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2023-07-20T14:59:40.598 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.619 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.error_if_exists: 0 2023-07-20T14:59:40.620 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.create_if_missing: 1 2023-07-20T14:59:40.620 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.paranoid_checks: 1 2023-07-20T14:59:40.620 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.env: 0x55aba91a71a0 2023-07-20T14:59:40.620 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.info_log: 0x55abaa781a80 2023-07-20T14:59:40.621 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.max_file_opening_threads: 16 2023-07-20T14:59:40.621 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.statistics: (nil) 2023-07-20T14:59:40.621 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.use_fsync: 0 2023-07-20T14:59:40.621 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.max_log_file_size: 0 2023-07-20T14:59:40.621 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-20T14:59:40.621 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.log_file_time_to_roll: 0 2023-07-20T14:59:40.621 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.keep_log_file_num: 1000 2023-07-20T14:59:40.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.recycle_log_file_num: 0 2023-07-20T14:59:40.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.allow_fallocate: 1 2023-07-20T14:59:40.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.allow_mmap_reads: 0 2023-07-20T14:59:40.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.allow_mmap_writes: 0 2023-07-20T14:59:40.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.use_direct_reads: 0 2023-07-20T14:59:40.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-20T14:59:40.636 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.create_missing_column_families: 0 2023-07-20T14:59:40.637 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.db_log_dir: 2023-07-20T14:59:40.637 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2023-07-20T14:59:40.637 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.table_cache_numshardbits: 6 2023-07-20T14:59:40.637 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.max_subcompactions: 1 2023-07-20T14:59:40.637 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.max_background_flushes: -1 2023-07-20T14:59:40.637 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-07-20T14:59:40.638 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-07-20T14:59:40.638 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-20T14:59:40.639 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-07-20T14:59:40.639 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.advise_random_on_open: 1 2023-07-20T14:59:40.639 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.db_write_buffer_size: 0 2023-07-20T14:59:40.639 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.write_buffer_manager: 0x55abab320120 2023-07-20T14:59:40.654 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-20T14:59:40.677 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-07-20T14:59:40.677 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-20T14:59:40.677 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.use_adaptive_mutex: 0 2023-07-20T14:59:40.677 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.rate_limiter: (nil) 2023-07-20T14:59:40.677 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-20T14:59:40.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.wal_recovery_mode: 2 2023-07-20T14:59:40.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.enable_thread_tracking: 0 2023-07-20T14:59:40.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.enable_pipelined_write: 0 2023-07-20T14:59:40.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-20T14:59:40.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-20T14:59:40.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-20T14:59:40.696 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-20T14:59:40.696 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.row_cache: None 2023-07-20T14:59:40.698 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.wal_filter: None 2023-07-20T14:59:40.698 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-20T14:59:40.706 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.allow_ingest_behind: 0 2023-07-20T14:59:40.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.preserve_deletes: 0 2023-07-20T14:59:40.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.two_write_queues: 0 2023-07-20T14:59:40.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.manual_wal_flush: 0 2023-07-20T14:59:40.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.atomic_flush: 0 2023-07-20T14:59:40.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-20T14:59:40.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.max_background_jobs: 2 2023-07-20T14:59:40.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.max_background_compactions: -1 2023-07-20T14:59:40.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-20T14:59:40.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-20T14:59:40.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.delayed_write_rate : 16777216 2023-07-20T14:59:40.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.max_total_wal_size: 0 2023-07-20T14:59:40.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-20T14:59:40.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.stats_dump_period_sec: 600 2023-07-20T14:59:40.731 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.stats_persist_period_sec: 600 2023-07-20T14:59:40.731 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-20T14:59:40.731 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.max_open_files: -1 2023-07-20T14:59:40.731 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.bytes_per_sync: 0 2023-07-20T14:59:40.731 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-07-20T14:59:40.732 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Options.compaction_readahead_size: 0 2023-07-20T14:59:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Compression algorithms supported: 2023-07-20T14:59:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-20T14:59:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: kZSTD supported: 0 2023-07-20T14:59:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: kXpressCompression supported: 0 2023-07-20T14:59:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: kLZ4HCCompression supported: 1 2023-07-20T14:59:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: kLZ4Compression supported: 1 2023-07-20T14:59:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: kBZip2Compression supported: 0 2023-07-20T14:59:40.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: kZlibCompression supported: 1 2023-07-20T14:59:40.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: kSnappyCompression supported: 1 2023-07-20T14:59:40.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-07-20T14:59:40.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.290+0000 7f0b51adb6c0 4 rocksdb: [db/db_impl_open.cc:228] Creating manifest 1 2023-07-20T14:59:40.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2023-07-20T14:59:40.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2023-07-20T14:59:40.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-20T14:59:40.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.merge_operator: 2023-07-20T14:59:40.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compaction_filter: None 2023-07-20T14:59:40.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compaction_filter_factory: None 2023-07-20T14:59:40.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-07-20T14:59:40.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.table_factory: BlockBasedTable 2023-07-20T14:59:40.740 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55abaa6a6130) 2023-07-20T14:59:40.740 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks: 1 2023-07-20T14:59:40.740 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks_with_high_priority: 1 2023-07-20T14:59:40.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-20T14:59:40.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_top_level_index_and_filter: 1 2023-07-20T14:59:40.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_type: 0 2023-07-20T14:59:40.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_index_type: 0 2023-07-20T14:59:40.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_hash_table_util_ratio: 0.750000 2023-07-20T14:59:40.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr hash_index_allow_collision: 1 2023-07-20T14:59:40.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr checksum: 1 2023-07-20T14:59:40.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr no_block_cache: 0 2023-07-20T14:59:40.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache: 0x55abaa6e0510 2023-07-20T14:59:40.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_name: BinnedLRUCache 2023-07-20T14:59:40.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_options: 2023-07-20T14:59:40.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr capacity : 536870912 2023-07-20T14:59:40.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr num_shard_bits : 4 2023-07-20T14:59:40.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr strict_capacity_limit : 0 2023-07-20T14:59:40.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr high_pri_pool_ratio: 0.000 2023-07-20T14:59:40.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_compressed: (nil) 2023-07-20T14:59:40.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr persistent_cache: (nil) 2023-07-20T14:59:40.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size: 4096 2023-07-20T14:59:40.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size_deviation: 10 2023-07-20T14:59:40.767 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_restart_interval: 16 2023-07-20T14:59:40.767 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_block_restart_interval: 1 2023-07-20T14:59:40.767 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr metadata_block_size: 4096 2023-07-20T14:59:40.767 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr partition_filters: 0 2023-07-20T14:59:40.767 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr use_delta_encoding: 1 2023-07-20T14:59:40.767 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr filter_policy: rocksdb.BuiltinBloomFilter 2023-07-20T14:59:40.767 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr whole_key_filtering: 1 2023-07-20T14:59:40.767 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr verify_compression: 0 2023-07-20T14:59:40.768 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr read_amp_bytes_per_bit: 0 2023-07-20T14:59:40.768 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr format_version: 2 2023-07-20T14:59:40.793 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr enable_index_compression: 1 2023-07-20T14:59:40.793 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_align: 0 2023-07-20T14:59:40.794 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.794 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.write_buffer_size: 33554432 2023-07-20T14:59:40.797 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.max_write_buffer_number: 2 2023-07-20T14:59:40.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compression: NoCompression 2023-07-20T14:59:40.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.bottommost_compression: Disabled 2023-07-20T14:59:40.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.prefix_extractor: nullptr 2023-07-20T14:59:40.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-20T14:59:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.num_levels: 7 2023-07-20T14:59:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-20T14:59:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-20T14:59:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-20T14:59:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-20T14:59:40.809 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-20T14:59:40.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-20T14:59:40.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-20T14:59:40.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-20T14:59:40.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compression_opts.window_bits: -14 2023-07-20T14:59:40.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compression_opts.level: 32767 2023-07-20T14:59:40.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compression_opts.strategy: 0 2023-07-20T14:59:40.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-20T14:59:40.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-20T14:59:40.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compression_opts.enabled: false 2023-07-20T14:59:40.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-20T14:59:40.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-20T14:59:40.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-20T14:59:40.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.target_file_size_base: 67108864 2023-07-20T14:59:40.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.target_file_size_multiplier: 1 2023-07-20T14:59:40.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-20T14:59:40.812 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-20T14:59:40.812 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-20T14:59:40.820 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-20T14:59:40.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-20T14:59:40.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-20T14:59:40.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-20T14:59:40.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-20T14:59:40.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-20T14:59:40.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-20T14:59:40.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-20T14:59:40.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-20T14:59:40.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.arena_block_size: 4194304 2023-07-20T14:59:40.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-20T14:59:40.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-20T14:59:40.832 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-07-20T14:59:40.832 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.disable_auto_compactions: 0 2023-07-20T14:59:40.832 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-20T14:59:40.832 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-20T14:59:40.832 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-20T14:59:40.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-20T14:59:40.838 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-20T14:59:40.838 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-20T14:59:40.838 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-20T14:59:40.838 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-20T14:59:40.838 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-20T14:59:40.839 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-20T14:59:40.839 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.table_properties_collectors: 2023-07-20T14:59:40.839 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.inplace_update_support: 0 2023-07-20T14:59:40.839 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-07-20T14:59:40.839 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-20T14:59:40.839 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-20T14:59:40.839 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.memtable_huge_page_size: 0 2023-07-20T14:59:40.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.bloom_locality: 0 2023-07-20T14:59:40.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.max_successive_merges: 0 2023-07-20T14:59:40.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-07-20T14:59:40.868 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.paranoid_file_checks: 0 2023-07-20T14:59:40.868 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.force_consistency_checks: 0 2023-07-20T14:59:40.868 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.report_bg_io_stats: 0 2023-07-20T14:59:40.868 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: Options.ttl: 0 2023-07-20T14:59:40.868 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-07-20T14:59:40.869 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.869 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.291+0000 7f0b51adb6c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2023-07-20T14:59:40.869 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.869 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.293+0000 7f0b51adb6c0 4 rocksdb: DB pointer 0x55abaa77c400 2023-07-20T14:59:40.869 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.293+0000 7f0b3ac9c700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2023-07-20T14:59:40.869 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.293+0000 7f0b3ac9c700 4 rocksdb: [db/db_impl.cc:778] 2023-07-20T14:59:40.869 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** DB Stats ** 2023-07-20T14:59:40.869 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2023-07-20T14:59:40.870 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-20T14:59:40.870 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-20T14:59:40.870 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-20T14:59:40.870 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-20T14:59:40.870 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-07-20T14:59:40.870 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-20T14:59:40.870 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.871 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2023-07-20T14:59:40.871 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T14:59:40.871 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T14:59:40.871 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-07-20T14:59:40.871 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-07-20T14:59:40.871 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.871 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2023-07-20T14:59:40.871 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T14:59:40.872 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T14:59:40.872 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2023-07-20T14:59:40.872 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2023-07-20T14:59:40.872 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2023-07-20T14:59:40.872 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2023-07-20T14:59:40.872 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2023-07-20T14:59:40.872 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2023-07-20T14:59:40.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T14:59:40.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T14:59:40.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-20T14:59:40.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2023-07-20T14:59:40.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2023-07-20T14:59:40.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T14:59:40.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T14:59:40.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-07-20T14:59:40.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-07-20T14:59:40.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2023-07-20T14:59:40.890 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T14:59:40.890 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T14:59:40.890 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2023-07-20T14:59:40.890 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2023-07-20T14:59:40.890 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2023-07-20T14:59:40.890 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2023-07-20T14:59:40.890 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2023-07-20T14:59:40.890 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2023-07-20T14:59:40.891 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T14:59:40.891 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T14:59:40.891 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-20T14:59:40.891 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.891 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2023-07-20T14:59:40.891 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2023-07-20T14:59:40.891 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.295+0000 7f0b51adb6c0 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work 2023-07-20T14:59:40.891 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.295+0000 7f0b51adb6c0 4 rocksdb: [db/db_impl.cc:563] Shutdown complete 2023-07-20T14:59:40.892 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2023-07-20T14:59:40.295+0000 7f0b51adb6c0 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2023-07-20T14:59:40.896 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T14:59:40.902 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl disable ceph.target 2023-07-20T14:59:40.902 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl enable ceph.target 2023-07-20T14:59:40.902 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-07-20T14:59:40.902 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl start ceph.target 2023-07-20T14:59:40.903 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-021c9860-270e-11ee-9b34-001a4aab830c.target 2023-07-20T14:59:40.903 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-021c9860-270e-11ee-9b34-001a4aab830c.target → /etc/systemd/system/ceph-021c9860-270e-11ee-9b34-001a4aab830c.target. 2023-07-20T14:59:40.903 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-021c9860-270e-11ee-9b34-001a4aab830c.target → /etc/systemd/system/ceph-021c9860-270e-11ee-9b34-001a4aab830c.target. 2023-07-20T14:59:40.980 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl start ceph-021c9860-270e-11ee-9b34-001a4aab830c.target 2023-07-20T14:59:40.995 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2023-07-20T14:59:41.082 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.a 2023-07-20T14:59:41.116 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.a 2023-07-20T14:59:41.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.a.service: Unit ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.a.service not loaded. 2023-07-20T14:59:41.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.a 2023-07-20T14:59:41.122 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-021c9860-270e-11ee-9b34-001a4aab830c.target.wants/ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-021c9860-270e-11ee-9b34-001a4aab830c@.service. 2023-07-20T14:59:41.207 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl start ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.a 2023-07-20T14:59:41.262 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl is-enabled firewalld.service 2023-07-20T14:59:41.266 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stdout disabled 2023-07-20T14:59:41.266 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl is-active firewalld.service 2023-07-20T14:59:41.285 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stdout inactive 2023-07-20T14:59:41.286 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:firewalld.service is not enabled 2023-07-20T14:59:41.286 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Waiting for mon to start... 2023-07-20T14:59:41.286 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Waiting for mon... 2023-07-20T14:59:41.286 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status 2023-07-20T14:59:41.518 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:41 smithi029 podman[104522]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon.a" found: no such container 2023-07-20T14:59:41.519 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:41 smithi029 systemd[1]: Started Ceph mon.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T14:59:41.841 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout cluster: 2023-07-20T14:59:41.842 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout id: 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T14:59:41.842 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout health: HEALTH_OK 2023-07-20T14:59:41.842 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2023-07-20T14:59:41.842 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout services: 2023-07-20T14:59:41.842 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon: 1 daemons, quorum a (age 0.217597s) 2023-07-20T14:59:41.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr: no daemons active 2023-07-20T14:59:41.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd: 0 osds: 0 up, 0 in 2023-07-20T14:59:41.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2023-07-20T14:59:41.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout data: 2023-07-20T14:59:41.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pools: 0 pools, 0 pgs 2023-07-20T14:59:41.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout objects: 0 objects, 0 B 2023-07-20T14:59:41.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout usage: 0 B used, 0 B / 0 B avail 2023-07-20T14:59:41.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pgs: 2023-07-20T14:59:41.844 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2023-07-20T14:59:41.870 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:41 smithi029 bash[104538]: cluster 2023-07-20T14:59:41.581972+0000 mon.a (mon.0) 0 : [INF] mkfs 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T14:59:41.877 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:41 smithi029 bash[104538]: cluster 2023-07-20T14:59:41.566996+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2023-07-20T14:59:42.231 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Assimilating anything we can from ceph.conf... 2023-07-20T14:59:42.236 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'assimilate-conf', '-i', '/var/lib/ceph/mon/ceph-a/config'] 2023-07-20T14:59:42.237 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z -v /var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2023-07-20T14:59:42.642 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2023-07-20T14:59:42.642 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [global] 2023-07-20T14:59:42.643 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout fsid = 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T14:59:42.643 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_election_default_strategy = 1 2023-07-20T14:59:42.643 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_host = [v2:172.21.15.29:3300,v1:172.21.15.29:6789] 2023-07-20T14:59:42.643 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_pg_remap = true 2023-07-20T14:59:42.643 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_primary_affinity = true 2023-07-20T14:59:42.643 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_no_sortbitwise = false 2023-07-20T14:59:42.643 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_crush_chooseleaf_type = 0 2023-07-20T14:59:42.644 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2023-07-20T14:59:42.644 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [mgr] 2023-07-20T14:59:42.644 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr/telemetry/nag = false 2023-07-20T14:59:42.679 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2023-07-20T14:59:42.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [mon] 2023-07-20T14:59:42.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_insecure_global_id_reclaim = false 2023-07-20T14:59:42.705 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-20T14:59:42.705 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2023-07-20T14:59:42.705 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [osd] 2023-07-20T14:59:42.705 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_map_max_advance = 10 2023-07-20T14:59:42.706 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_memory_target_autotune = true 2023-07-20T14:59:42.706 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_sloppy_crc = true 2023-07-20T14:59:42.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:42 smithi029 bash[104538]: cluster 2023-07-20T14:59:41.581561+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2023-07-20T14:59:42.914 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:42 smithi029 bash[104538]: cluster 2023-07-20T14:59:41.581683+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0]} 2023-07-20T14:59:42.914 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:42 smithi029 bash[104538]: cluster 2023-07-20T14:59:41.583002+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2023-07-20T14:59:42.914 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:42 smithi029 bash[104538]: cluster 2023-07-20T14:59:41.584588+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2023-07-20T14:59:42.965 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:42 smithi029 bash[104538]: cluster 2023-07-20T14:59:41.584916+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2023-07-20T14:59:42.966 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:42 smithi029 bash[104538]: audit 2023-07-20T14:59:41.799130+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.29:0/2340202399' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-07-20T14:59:42.985 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Generating new minimal ceph.conf... 2023-07-20T14:59:42.986 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'generate-minimal-conf', '-o', '/var/lib/ceph/mon/ceph-a/config'] 2023-07-20T14:59:42.986 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z -v /var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2023-07-20T14:59:43.823 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Restarting the monitor... 2023-07-20T14:59:43.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl restart ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.a 2023-07-20T14:59:43.824 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:43 smithi029 bash[104538]: audit 2023-07-20T14:59:42.593331+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.29:0/3672142561' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-07-20T14:59:43.824 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:43 smithi029 bash[104538]: audit 2023-07-20T14:59:42.595541+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.29:0/3672142561' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-07-20T14:59:43.824 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:43 smithi029 bash[104538]: audit 2023-07-20T14:59:43.423511+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.29:0/2247888964' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T14:59:44.217 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:43 smithi029 systemd[1]: Stopping Ceph mon.a for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T14:59:44.226 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:43 smithi029 bash[104538]: debug 2023-07-20T14:59:43.805+0000 7f60b4117700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T14:59:44.226 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:43 smithi029 bash[104538]: debug 2023-07-20T14:59:43.805+0000 7f60b4117700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-07-20T14:59:44.426 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Setting mon public_network... 2023-07-20T14:59:44.426 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'set', 'mon', 'public_network', '172.21.0.0/20'] 2023-07-20T14:59:44.427 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config set mon public_network 172.21.0.0/20 2023-07-20T14:59:44.538 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 podman[104873]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon.a 2023-07-20T14:59:44.569 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.a.service: Succeeded. 2023-07-20T14:59:44.569 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 systemd[1]: Stopped Ceph mon.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T14:59:44.569 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 systemd[1]: Starting Ceph mon.a for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T14:59:44.569 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 podman[104917]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon.a" found: no such container 2023-07-20T14:59:44.569 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 systemd[1]: Started Ceph mon.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T14:59:45.143 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.753+0000 7efeeb7926c0 0 set uid:gid to 167:167 (ceph:ceph) 2023-07-20T14:59:45.144 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.753+0000 7efeeb7926c0 0 ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc), process ceph-mon, pid 1 2023-07-20T14:59:45.144 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.753+0000 7efeeb7926c0 0 pidfile_write: ignore empty --pid-file 2023-07-20T14:59:45.144 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.758+0000 7efeeb7926c0 0 load: jerasure load: lrc load: isa 2023-07-20T14:59:45.144 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.758+0000 7efeeb7926c0 0 set rocksdb option compression = kNoCompression 2023-07-20T14:59:45.145 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.758+0000 7efeeb7926c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2023-07-20T14:59:45.175 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.758+0000 7efeeb7926c0 0 set rocksdb option write_buffer_size = 33554432 2023-07-20T14:59:45.175 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.758+0000 7efeeb7926c0 0 set rocksdb option compression = kNoCompression 2023-07-20T14:59:45.175 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.758+0000 7efeeb7926c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2023-07-20T14:59:45.175 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.758+0000 7efeeb7926c0 0 set rocksdb option write_buffer_size = 33554432 2023-07-20T14:59:45.176 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 1 rocksdb: do_open column families: [default] 2023-07-20T14:59:45.176 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: RocksDB version: 6.1.2 2023-07-20T14:59:45.176 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-07-20T14:59:45.176 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Compile date Mar 23 2020 2023-07-20T14:59:45.176 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: DB SUMMARY 2023-07-20T14:59:45.225 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: CURRENT file: CURRENT 2023-07-20T14:59:45.225 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: IDENTITY file: IDENTITY 2023-07-20T14:59:45.225 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 109 Bytes 2023-07-20T14:59:45.225 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2023-07-20T14:59:45.225 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 64603 ; 2023-07-20T14:59:45.225 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.error_if_exists: 0 2023-07-20T14:59:45.226 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.create_if_missing: 0 2023-07-20T14:59:45.226 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.paranoid_checks: 1 2023-07-20T14:59:45.226 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.env: 0x5574da17c1a0 2023-07-20T14:59:45.226 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.info_log: 0x5574db2189a0 2023-07-20T14:59:45.226 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_file_opening_threads: 16 2023-07-20T14:59:45.226 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.statistics: (nil) 2023-07-20T14:59:45.226 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.use_fsync: 0 2023-07-20T14:59:45.227 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_log_file_size: 0 2023-07-20T14:59:45.227 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-20T14:59:45.227 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.log_file_time_to_roll: 0 2023-07-20T14:59:45.227 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.keep_log_file_num: 1000 2023-07-20T14:59:45.227 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.recycle_log_file_num: 0 2023-07-20T14:59:45.227 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.allow_fallocate: 1 2023-07-20T14:59:45.227 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.allow_mmap_reads: 0 2023-07-20T14:59:45.239 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.allow_mmap_writes: 0 2023-07-20T14:59:45.239 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.use_direct_reads: 0 2023-07-20T14:59:45.239 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-20T14:59:45.239 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.create_missing_column_families: 0 2023-07-20T14:59:45.240 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.db_log_dir: 2023-07-20T14:59:45.240 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2023-07-20T14:59:45.240 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.table_cache_numshardbits: 6 2023-07-20T14:59:45.240 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_subcompactions: 1 2023-07-20T14:59:45.240 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_background_flushes: -1 2023-07-20T14:59:45.240 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-07-20T14:59:45.240 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-07-20T14:59:45.241 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-20T14:59:45.241 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-07-20T14:59:45.241 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.advise_random_on_open: 1 2023-07-20T14:59:45.241 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.db_write_buffer_size: 0 2023-07-20T14:59:45.241 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.write_buffer_manager: 0x5574dbdb0ae0 2023-07-20T14:59:45.241 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-20T14:59:45.241 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-07-20T14:59:45.242 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-20T14:59:45.242 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.use_adaptive_mutex: 0 2023-07-20T14:59:45.242 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.rate_limiter: (nil) 2023-07-20T14:59:45.242 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-20T14:59:45.242 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.wal_recovery_mode: 2 2023-07-20T14:59:45.242 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.enable_thread_tracking: 0 2023-07-20T14:59:45.244 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.enable_pipelined_write: 0 2023-07-20T14:59:45.244 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-20T14:59:45.297 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-20T14:59:45.300 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-20T14:59:45.302 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-20T14:59:45.303 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.row_cache: None 2023-07-20T14:59:45.304 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.wal_filter: None 2023-07-20T14:59:45.345 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-20T14:59:45.382 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.allow_ingest_behind: 0 2023-07-20T14:59:45.382 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.preserve_deletes: 0 2023-07-20T14:59:45.382 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.two_write_queues: 0 2023-07-20T14:59:45.382 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.manual_wal_flush: 0 2023-07-20T14:59:45.383 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.atomic_flush: 0 2023-07-20T14:59:45.383 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-20T14:59:45.383 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_background_jobs: 2 2023-07-20T14:59:45.383 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_background_compactions: -1 2023-07-20T14:59:45.383 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-20T14:59:45.383 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-20T14:59:45.383 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.delayed_write_rate : 16777216 2023-07-20T14:59:45.384 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_total_wal_size: 0 2023-07-20T14:59:45.384 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-20T14:59:45.414 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.stats_dump_period_sec: 600 2023-07-20T14:59:45.414 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.stats_persist_period_sec: 600 2023-07-20T14:59:45.419 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-20T14:59:45.419 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_open_files: -1 2023-07-20T14:59:45.419 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.bytes_per_sync: 0 2023-07-20T14:59:45.419 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-07-20T14:59:45.420 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compaction_readahead_size: 0 2023-07-20T14:59:45.420 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Compression algorithms supported: 2023-07-20T14:59:45.420 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-20T14:59:45.442 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: kZSTD supported: 0 2023-07-20T14:59:45.442 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: kXpressCompression supported: 0 2023-07-20T14:59:45.464 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: kLZ4HCCompression supported: 1 2023-07-20T14:59:45.466 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: kLZ4Compression supported: 1 2023-07-20T14:59:45.466 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: kBZip2Compression supported: 0 2023-07-20T14:59:45.467 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: kZlibCompression supported: 1 2023-07-20T14:59:45.494 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: kSnappyCompression supported: 1 2023-07-20T14:59:45.494 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-07-20T14:59:45.494 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2023-07-20T14:59:45.494 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2023-07-20T14:59:45.494 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-20T14:59:45.501 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.merge_operator: 2023-07-20T14:59:45.502 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compaction_filter: None 2023-07-20T14:59:45.502 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compaction_filter_factory: None 2023-07-20T14:59:45.502 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-07-20T14:59:45.502 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.table_factory: BlockBasedTable 2023-07-20T14:59:45.502 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5574db134138) 2023-07-20T14:59:45.502 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: cache_index_and_filter_blocks: 1 2023-07-20T14:59:45.502 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: cache_index_and_filter_blocks_with_high_priority: 1 2023-07-20T14:59:45.503 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-20T14:59:45.503 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: pin_top_level_index_and_filter: 1 2023-07-20T14:59:45.503 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: index_type: 0 2023-07-20T14:59:45.503 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: data_block_index_type: 0 2023-07-20T14:59:45.503 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: data_block_hash_table_util_ratio: 0.750000 2023-07-20T14:59:45.503 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: hash_index_allow_collision: 1 2023-07-20T14:59:45.527 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: checksum: 1 2023-07-20T14:59:45.527 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: no_block_cache: 0 2023-07-20T14:59:45.527 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: block_cache: 0x5574db16e610 2023-07-20T14:59:45.527 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: block_cache_name: BinnedLRUCache 2023-07-20T14:59:45.527 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: block_cache_options: 2023-07-20T14:59:45.527 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: capacity : 536870912 2023-07-20T14:59:45.528 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: num_shard_bits : 4 2023-07-20T14:59:45.528 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: strict_capacity_limit : 0 2023-07-20T14:59:45.539 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: high_pri_pool_ratio: 0.000 2023-07-20T14:59:45.539 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: block_cache_compressed: (nil) 2023-07-20T14:59:45.539 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: persistent_cache: (nil) 2023-07-20T14:59:45.539 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: block_size: 4096 2023-07-20T14:59:45.540 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: block_size_deviation: 10 2023-07-20T14:59:45.540 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: block_restart_interval: 16 2023-07-20T14:59:45.540 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: index_block_restart_interval: 1 2023-07-20T14:59:45.540 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: metadata_block_size: 4096 2023-07-20T14:59:45.540 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: partition_filters: 0 2023-07-20T14:59:45.540 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: use_delta_encoding: 1 2023-07-20T14:59:45.541 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: filter_policy: rocksdb.BuiltinBloomFilter 2023-07-20T14:59:45.613 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: whole_key_filtering: 1 2023-07-20T14:59:45.614 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: verify_compression: 0 2023-07-20T14:59:45.614 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: read_amp_bytes_per_bit: 0 2023-07-20T14:59:45.614 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: format_version: 2 2023-07-20T14:59:45.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: enable_index_compression: 1 2023-07-20T14:59:45.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: block_align: 0 2023-07-20T14:59:45.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.write_buffer_size: 33554432 2023-07-20T14:59:45.626 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_write_buffer_number: 2 2023-07-20T14:59:45.649 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compression: NoCompression 2023-07-20T14:59:45.650 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.bottommost_compression: Disabled 2023-07-20T14:59:45.650 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.prefix_extractor: nullptr 2023-07-20T14:59:45.650 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-20T14:59:45.650 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.num_levels: 7 2023-07-20T14:59:45.650 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-20T14:59:45.651 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-20T14:59:45.651 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-20T14:59:45.651 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-20T14:59:45.688 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-20T14:59:45.694 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-20T14:59:45.694 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-20T14:59:45.694 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-20T14:59:45.694 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compression_opts.window_bits: -14 2023-07-20T14:59:45.695 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compression_opts.level: 32767 2023-07-20T14:59:45.770 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compression_opts.strategy: 0 2023-07-20T14:59:45.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-20T14:59:45.787 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-20T14:59:45.787 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compression_opts.enabled: false 2023-07-20T14:59:45.787 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-20T14:59:45.787 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-20T14:59:45.787 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-20T14:59:45.787 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.target_file_size_base: 67108864 2023-07-20T14:59:45.788 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.target_file_size_multiplier: 1 2023-07-20T14:59:45.788 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-20T14:59:45.788 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-20T14:59:45.788 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-20T14:59:45.788 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-20T14:59:45.788 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-20T14:59:45.788 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-20T14:59:45.788 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-20T14:59:45.789 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-20T14:59:45.789 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-20T14:59:45.789 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-20T14:59:45.789 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-20T14:59:45.789 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-20T14:59:45.789 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.arena_block_size: 4194304 2023-07-20T14:59:45.789 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-20T14:59:45.789 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-20T14:59:45.790 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-07-20T14:59:45.790 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.disable_auto_compactions: 0 2023-07-20T14:59:45.790 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-20T14:59:45.790 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-20T14:59:45.790 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-20T14:59:45.790 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-20T14:59:45.790 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-20T14:59:45.791 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-20T14:59:45.791 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-20T14:59:45.791 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-20T14:59:45.791 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-20T14:59:45.791 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-20T14:59:45.791 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.table_properties_collectors: 2023-07-20T14:59:45.791 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.inplace_update_support: 0 2023-07-20T14:59:45.791 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-07-20T14:59:45.792 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-20T14:59:45.792 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-20T14:59:45.805 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.memtable_huge_page_size: 0 2023-07-20T14:59:45.805 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.bloom_locality: 0 2023-07-20T14:59:45.806 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.max_successive_merges: 0 2023-07-20T14:59:45.806 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-07-20T14:59:45.806 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.paranoid_file_checks: 0 2023-07-20T14:59:45.806 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.force_consistency_checks: 0 2023-07-20T14:59:45.806 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.report_bg_io_stats: 0 2023-07-20T14:59:45.806 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.759+0000 7efeeb7926c0 4 rocksdb: Options.ttl: 0 2023-07-20T14:59:45.806 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.760+0000 7efeeb7926c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-07-20T14:59:45.825 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.760+0000 7efeeb7926c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 4 2023-07-20T14:59:45.825 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.760+0000 7efeeb7926c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689865184760914, "job": 1, "event": "recovery_started", "log_files": [6]} 2023-07-20T14:59:45.825 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.760+0000 7efeeb7926c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #6 mode 2 2023-07-20T14:59:45.830 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.761+0000 7efeeb7926c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689865184762015, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 61845, "table_properties": {"data_size": 60167, "index_size": 283, "filter_size": 581, "raw_key_size": 8582, "raw_average_key_size": 47, "raw_value_size": 55241, "raw_average_value_size": 303, "num_data_blocks": 9, "num_entries": 182, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2023-07-20T14:59:45.830 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.761+0000 7efeeb7926c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 8 2023-07-20T14:59:45.830 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.762+0000 7efeeb7926c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689865184762520, "job": 1, "event": "recovery_finished"} 2023-07-20T14:59:45.830 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.763+0000 7efeeb7926c0 4 rocksdb: DB pointer 0x5574db209200 2023-07-20T14:59:45.868 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.763+0000 7efed28df700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2023-07-20T14:59:45.869 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.763+0000 7efed28df700 4 rocksdb: [db/db_impl.cc:778] 2023-07-20T14:59:45.869 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: ** DB Stats ** 2023-07-20T14:59:45.869 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-20T14:59:45.869 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-20T14:59:45.869 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-20T14:59:45.869 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-20T14:59:45.869 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-20T14:59:45.870 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-07-20T14:59:45.870 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-20T14:59:45.870 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: ** Compaction Stats [default] ** 2023-07-20T14:59:45.870 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T14:59:45.870 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T14:59:45.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: L0 2/0 62.02 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.0 0.00 0.00 1 0.001 0 0 2023-07-20T14:59:45.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Sum 2/0 62.02 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.0 0.00 0.00 1 0.001 0 0 2023-07-20T14:59:45.908 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.0 0.00 0.00 1 0.001 0 0 2023-07-20T14:59:45.910 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: ** Compaction Stats [default] ** 2023-07-20T14:59:45.937 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T14:59:45.940 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T14:59:45.940 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 90.0 0.00 0.00 1 0.001 0 0 2023-07-20T14:59:45.940 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-20T14:59:45.940 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Flush(GB): cumulative 0.000, interval 0.000 2023-07-20T14:59:45.940 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-20T14:59:45.941 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: AddFile(Total Files): cumulative 0, interval 0 2023-07-20T14:59:45.941 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: AddFile(L0 Files): cumulative 0, interval 0 2023-07-20T14:59:45.942 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: AddFile(Keys): cumulative 0, interval 0 2023-07-20T14:59:45.942 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Cumulative compaction: 0.00 GB write, 14.76 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T14:59:45.942 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Interval compaction: 0.00 GB write, 14.76 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T14:59:45.942 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-20T14:59:45.980 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: ** File Read Latency Histogram By Level [default] ** 2023-07-20T14:59:45.980 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: ** Compaction Stats [default] ** 2023-07-20T14:59:45.982 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T14:59:45.983 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T14:59:46.003 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: L0 2/0 62.02 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.0 0.00 0.00 1 0.001 0 0 2023-07-20T14:59:46.003 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Sum 2/0 62.02 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.0 0.00 0.00 1 0.001 0 0 2023-07-20T14:59:46.003 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-07-20T14:59:46.003 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: ** Compaction Stats [default] ** 2023-07-20T14:59:46.004 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T14:59:46.092 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T14:59:46.092 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 90.0 0.00 0.00 1 0.001 0 0 2023-07-20T14:59:46.092 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-20T14:59:46.092 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Flush(GB): cumulative 0.000, interval 0.000 2023-07-20T14:59:46.092 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-20T14:59:46.092 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: AddFile(Total Files): cumulative 0, interval 0 2023-07-20T14:59:46.093 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: AddFile(L0 Files): cumulative 0, interval 0 2023-07-20T14:59:46.093 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: AddFile(Keys): cumulative 0, interval 0 2023-07-20T14:59:46.093 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Cumulative compaction: 0.00 GB write, 14.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T14:59:46.093 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T14:59:46.093 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-20T14:59:46.093 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: ** File Read Latency Histogram By Level [default] ** 2023-07-20T14:59:46.093 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.764+0000 7efeeb7926c0 0 starting mon.a rank 0 at public addrs [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] at bind addrs [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T14:59:46.093 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.766+0000 7efeeb7926c0 1 mon.a@-1(???) e1 preinit fsid 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T14:59:46.094 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.766+0000 7efeeb7926c0 0 mon.a@-1(???).mds e1 new map 2023-07-20T14:59:46.094 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.766+0000 7efeeb7926c0 0 mon.a@-1(???).mds e1 print_map 2023-07-20T14:59:46.094 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: e1 2023-07-20T14:59:46.094 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: enable_multiple, ever_enabled_multiple: 0,0 2023-07-20T14:59:46.094 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-20T14:59:46.094 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: legacy client fscid: -1 2023-07-20T14:59:46.094 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: 2023-07-20T14:59:46.095 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: No filesystems configured 2023-07-20T14:59:46.095 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.766+0000 7efeeb7926c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-07-20T14:59:46.095 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.766+0000 7efeeb7926c0 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-07-20T14:59:46.095 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.766+0000 7efeeb7926c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-07-20T14:59:46.095 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: audit 2023-07-20T14:59:42.593331+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.29:0/3672142561' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-07-20T14:59:46.095 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: audit 2023-07-20T14:59:42.595541+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.29:0/3672142561' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-07-20T14:59:46.095 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: audit 2023-07-20T14:59:43.423511+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.29:0/2247888964' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T14:59:46.095 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: debug 2023-07-20T14:59:44.766+0000 7efeeb7926c0 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-07-20T14:59:46.096 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: cluster 2023-07-20T14:59:44.783015+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2023-07-20T14:59:46.096 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: cluster 2023-07-20T14:59:44.783058+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0]} 2023-07-20T14:59:46.096 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: cluster 2023-07-20T14:59:44.783089+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2023-07-20T14:59:46.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: cluster 2023-07-20T14:59:44.783113+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2023-07-20T14:59:46.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:44 smithi029 bash[104935]: cluster 2023-07-20T14:59:44.783393+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2023-07-20T14:59:46.203 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Creating mgr... 2023-07-20T14:59:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2023-07-20T14:59:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.y 2023-07-20T14:59:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.y 2023-07-20T14:59:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.y.service: Unit ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.y.service not loaded. 2023-07-20T14:59:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.y 2023-07-20T14:59:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-021c9860-270e-11ee-9b34-001a4aab830c.target.wants/ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.y.service → /etc/systemd/system/ceph-021c9860-270e-11ee-9b34-001a4aab830c@.service. 2023-07-20T14:59:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl start ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.y 2023-07-20T14:59:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl is-enabled firewalld.service 2023-07-20T14:59:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stdout disabled 2023-07-20T14:59:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: systemctl is-active firewalld.service 2023-07-20T14:59:46.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:systemctl:stdout inactive 2023-07-20T14:59:46.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:firewalld.service is not enabled 2023-07-20T14:59:46.274 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-07-20T14:59:46.274 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Wrote config to /etc/ceph/ceph.conf 2023-07-20T14:59:46.274 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Waiting for mgr to start... 2023-07-20T14:59:46.275 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Waiting for mgr... 2023-07-20T14:59:46.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2023-07-20T14:59:46.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2023-07-20T14:59:46.275 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 14:59:45 smithi029 podman[105153]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr.y" found: no such container 2023-07-20T14:59:46.276 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 14:59:45 smithi029 systemd[1]: Started Ceph mgr.y for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T14:59:46.366 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:45 smithi029 bash[104935]: audit 2023-07-20T14:59:45.010093+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.29:0/1562926997' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]: dispatch 2023-07-20T14:59:46.367 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:45 smithi029 bash[104935]: audit 2023-07-20T14:59:45.011978+0000 mon.a (mon.0) 7 : audit [INF] from='client.? 172.21.15.29:0/1562926997' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]': finished 2023-07-20T14:59:46.618 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2023-07-20T14:59:46.638 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T14:59:46.639 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "021c9860-270e-11ee-9b34-001a4aab830c", 2023-07-20T14:59:46.639 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2023-07-20T14:59:46.639 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2023-07-20T14:59:46.639 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2023-07-20T14:59:46.639 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2023-07-20T14:59:46.639 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:46.666 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2023-07-20T14:59:46.666 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2023-07-20T14:59:46.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2023-07-20T14:59:46.714 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:46.714 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2023-07-20T14:59:46.714 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2023-07-20T14:59:46.716 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:46.716 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 1, 2023-07-20T14:59:46.716 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2023-07-20T14:59:46.716 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2023-07-20T14:59:46.733 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2023-07-20T14:59:46.733 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2023-07-20T14:59:46.733 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:46.734 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2023-07-20T14:59:46.780 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2023-07-20T14:59:46.781 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2023-07-20T14:59:46.781 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2023-07-20T14:59:46.781 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2023-07-20T14:59:46.781 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2023-07-20T14:59:46.781 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2023-07-20T14:59:46.781 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2023-07-20T14:59:46.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:46.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2023-07-20T14:59:46.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2023-07-20T14:59:46.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2023-07-20T14:59:46.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2023-07-20T14:59:46.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2023-07-20T14:59:46.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2023-07-20T14:59:46.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2023-07-20T14:59:46.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2023-07-20T14:59:46.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2023-07-20T14:59:46.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:46.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2023-07-20T14:59:46.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2023-07-20T14:59:46.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2023-07-20T14:59:46.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2023-07-20T14:59:46.784 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:46.784 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2023-07-20T14:59:46.832 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2023-07-20T14:59:46.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2023-07-20T14:59:46.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2023-07-20T14:59:46.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2023-07-20T14:59:46.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2023-07-20T14:59:46.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:46.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2023-07-20T14:59:46.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:46.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2023-07-20T14:59:46.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2023-07-20T14:59:46.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2023-07-20T14:59:41.582314+0000", 2023-07-20T14:59:46.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2023-07-20T14:59:46.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:46.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2023-07-20T14:59:46.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T14:59:46.835 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:mgr not available, waiting (1/10)... 2023-07-20T14:59:46.881 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:46 smithi029 bash[104935]: audit 2023-07-20T14:59:46.202664+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.29:0/784075578' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-20T14:59:47.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2023-07-20T14:59:47.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2023-07-20T14:59:48.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2023-07-20T14:59:48.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T14:59:48.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "021c9860-270e-11ee-9b34-001a4aab830c", 2023-07-20T14:59:48.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2023-07-20T14:59:48.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2023-07-20T14:59:48.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2023-07-20T14:59:48.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2023-07-20T14:59:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:48.154 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2023-07-20T14:59:48.154 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2023-07-20T14:59:48.154 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2023-07-20T14:59:48.154 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:48.154 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2023-07-20T14:59:48.154 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2023-07-20T14:59:48.154 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 3, 2023-07-20T14:59:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2023-07-20T14:59:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2023-07-20T14:59:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2023-07-20T14:59:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2023-07-20T14:59:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2023-07-20T14:59:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2023-07-20T14:59:48.156 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2023-07-20T14:59:48.156 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2023-07-20T14:59:48.182 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2023-07-20T14:59:48.183 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2023-07-20T14:59:48.183 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2023-07-20T14:59:48.184 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2023-07-20T14:59:48.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:48.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2023-07-20T14:59:48.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2023-07-20T14:59:48.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2023-07-20T14:59:48.216 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2023-07-20T14:59:48.216 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2023-07-20T14:59:48.221 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2023-07-20T14:59:48.221 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2023-07-20T14:59:48.221 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2023-07-20T14:59:48.221 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2023-07-20T14:59:48.222 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:48.222 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2023-07-20T14:59:48.222 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2023-07-20T14:59:48.222 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2023-07-20T14:59:48.238 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2023-07-20T14:59:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2023-07-20T14:59:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2023-07-20T14:59:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2023-07-20T14:59:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2023-07-20T14:59:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2023-07-20T14:59:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2023-07-20T14:59:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:48.241 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2023-07-20T14:59:48.242 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:48.242 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2023-07-20T14:59:48.242 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2023-07-20T14:59:48.242 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2023-07-20T14:59:41.582314+0000", 2023-07-20T14:59:48.242 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2023-07-20T14:59:48.242 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:48.242 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2023-07-20T14:59:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T14:59:48.367 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:48 smithi029 bash[104935]: audit 2023-07-20T14:59:48.008360+0000 mon.a (mon.0) 9 : audit [DBG] from='client.? 172.21.15.29:0/3695866640' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-20T14:59:48.449 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:mgr not available, waiting (2/10)... 2023-07-20T14:59:49.449 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2023-07-20T14:59:49.449 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2023-07-20T14:59:50.266 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2023-07-20T14:59:50.267 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T14:59:50.267 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "021c9860-270e-11ee-9b34-001a4aab830c", 2023-07-20T14:59:50.267 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2023-07-20T14:59:50.267 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2023-07-20T14:59:50.267 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2023-07-20T14:59:50.267 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2023-07-20T14:59:50.267 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:50.268 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2023-07-20T14:59:50.268 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2023-07-20T14:59:50.268 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2023-07-20T14:59:50.302 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:50.319 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2023-07-20T14:59:50.319 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2023-07-20T14:59:50.320 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:50.320 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 5, 2023-07-20T14:59:50.320 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2023-07-20T14:59:50.320 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2023-07-20T14:59:50.365 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2023-07-20T14:59:50.365 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2023-07-20T14:59:50.365 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:50.365 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2023-07-20T14:59:50.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2023-07-20T14:59:50.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2023-07-20T14:59:50.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2023-07-20T14:59:50.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2023-07-20T14:59:50.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2023-07-20T14:59:50.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2023-07-20T14:59:50.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2023-07-20T14:59:50.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:50.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2023-07-20T14:59:50.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2023-07-20T14:59:50.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2023-07-20T14:59:50.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2023-07-20T14:59:50.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2023-07-20T14:59:50.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2023-07-20T14:59:50.368 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2023-07-20T14:59:50.368 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2023-07-20T14:59:50.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2023-07-20T14:59:50.385 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:50.385 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2023-07-20T14:59:50.385 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2023-07-20T14:59:50.385 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2023-07-20T14:59:50.385 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2023-07-20T14:59:50.386 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:50.386 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2023-07-20T14:59:50.386 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2023-07-20T14:59:50.386 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2023-07-20T14:59:50.386 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2023-07-20T14:59:50.386 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2023-07-20T14:59:50.386 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2023-07-20T14:59:50.386 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:50.387 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2023-07-20T14:59:50.387 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:50.387 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2023-07-20T14:59:50.471 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2023-07-20T14:59:50.471 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2023-07-20T14:59:41.582314+0000", 2023-07-20T14:59:50.471 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2023-07-20T14:59:50.471 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:50.471 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2023-07-20T14:59:50.472 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T14:59:50.627 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:mgr not available, waiting (3/10)... 2023-07-20T14:59:50.978 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:50 smithi029 bash[104935]: cluster 2023-07-20T14:59:49.779302+0000 mon.a (mon.0) 10 : cluster [INF] Activating manager daemon y 2023-07-20T14:59:50.979 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:50 smithi029 bash[104935]: cluster 2023-07-20T14:59:49.781663+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00247243s) 2023-07-20T14:59:50.992 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:50 smithi029 bash[104935]: audit 2023-07-20T14:59:49.782529+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.29:0/2451551534' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-20T14:59:50.993 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:50 smithi029 bash[104935]: audit 2023-07-20T14:59:49.782714+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.29:0/2451551534' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-20T14:59:50.993 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:50 smithi029 bash[104935]: audit 2023-07-20T14:59:49.782891+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.29:0/2451551534' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-20T14:59:50.993 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:50 smithi029 bash[104935]: audit 2023-07-20T14:59:49.783235+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.29:0/2451551534' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-20T14:59:50.994 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:50 smithi029 bash[104935]: audit 2023-07-20T14:59:49.783453+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.14100 172.21.15.29:0/2451551534' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2023-07-20T14:59:50.995 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:50 smithi029 bash[104935]: cluster 2023-07-20T14:59:49.785598+0000 mon.a (mon.0) 17 : cluster [INF] Manager daemon y is now available 2023-07-20T14:59:50.995 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:50 smithi029 bash[104935]: audit 2023-07-20T14:59:49.795197+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.29:0/2451551534' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2023-07-20T14:59:50.995 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:50 smithi029 bash[104935]: audit 2023-07-20T14:59:50.223358+0000 mon.a (mon.0) 19 : audit [DBG] from='client.? 172.21.15.29:0/1176414970' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-20T14:59:50.995 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:50 smithi029 bash[104935]: audit 2023-07-20T14:59:50.225552+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.29:0/2451551534' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2023-07-20T14:59:50.995 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:50 smithi029 bash[104935]: cluster 2023-07-20T14:59:50.225597+0000 mon.a (mon.0) 21 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2023-07-20T14:59:50.995 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:50 smithi029 bash[104935]: audit 2023-07-20T14:59:50.226407+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.14100 172.21.15.29:0/2451551534' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-07-20T14:59:50.995 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:50 smithi029 bash[104935]: audit 2023-07-20T14:59:50.233782+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.15.29:0/2451551534' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"d5238a40-6b78-4e8e-beb1-04d168b04079"}]: dispatch 2023-07-20T14:59:50.996 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:50 smithi029 bash[104935]: audit 2023-07-20T14:59:50.235602+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.15.29:0/2451551534' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"d5238a40-6b78-4e8e-beb1-04d168b04079"}]': finished 2023-07-20T14:59:50.996 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:50 smithi029 bash[104935]: audit 2023-07-20T14:59:50.236000+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.15.29:0/2451551534' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"788186d4-758d-41d0-aeba-25d750eba935"}]: dispatch 2023-07-20T14:59:50.996 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:50 smithi029 bash[104935]: audit 2023-07-20T14:59:50.237461+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.14100 172.21.15.29:0/2451551534' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"788186d4-758d-41d0-aeba-25d750eba935"}]': finished 2023-07-20T14:59:51.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2023-07-20T14:59:51.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2023-07-20T14:59:52.387 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2023-07-20T14:59:52.388 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T14:59:52.388 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "021c9860-270e-11ee-9b34-001a4aab830c", 2023-07-20T14:59:52.460 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2023-07-20T14:59:52.460 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2023-07-20T14:59:52.461 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2023-07-20T14:59:52.461 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2023-07-20T14:59:52.461 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:52.462 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2023-07-20T14:59:52.462 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2023-07-20T14:59:52.462 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2023-07-20T14:59:52.462 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:52.462 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2023-07-20T14:59:52.462 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2023-07-20T14:59:52.463 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:52.463 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 7, 2023-07-20T14:59:52.463 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2023-07-20T14:59:52.463 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2023-07-20T14:59:52.463 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2023-07-20T14:59:52.463 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2023-07-20T14:59:52.463 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:52.463 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2023-07-20T14:59:52.464 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 3, 2023-07-20T14:59:52.464 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2023-07-20T14:59:52.464 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2023-07-20T14:59:52.464 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2023-07-20T14:59:52.464 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2023-07-20T14:59:52.464 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2023-07-20T14:59:52.464 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2023-07-20T14:59:52.465 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:52.465 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2023-07-20T14:59:52.465 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2023-07-20T14:59:52.465 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2023-07-20T14:59:52.465 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2023-07-20T14:59:52.465 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2023-07-20T14:59:52.465 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2023-07-20T14:59:52.466 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2023-07-20T14:59:52.466 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2023-07-20T14:59:52.466 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2023-07-20T14:59:52.466 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:52.466 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2023-07-20T14:59:52.504 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2023-07-20T14:59:52.505 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2023-07-20T14:59:52.505 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2023-07-20T14:59:52.505 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:52.505 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2023-07-20T14:59:52.505 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2023-07-20T14:59:52.505 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2023-07-20T14:59:52.505 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2023-07-20T14:59:52.506 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2023-07-20T14:59:52.506 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2023-07-20T14:59:52.506 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:52.506 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2023-07-20T14:59:52.506 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:52.506 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2023-07-20T14:59:52.506 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2023-07-20T14:59:52.506 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2023-07-20T14:59:41.582314+0000", 2023-07-20T14:59:52.507 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2023-07-20T14:59:52.507 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:52.507 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2023-07-20T14:59:52.507 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T14:59:52.508 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:52 smithi029 bash[104935]: cluster 2023-07-20T14:59:50.783996+0000 mon.a (mon.0) 27 : cluster [DBG] mgrmap e3: y(active, since 1.00481s) 2023-07-20T14:59:52.508 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:52 smithi029 bash[104935]: audit 2023-07-20T14:59:51.225873+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.14100 172.21.15.29:0/2451551534' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-07-20T14:59:52.529 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:52 smithi029 bash[104935]: cluster 2023-07-20T14:59:51.225915+0000 mon.a (mon.0) 29 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2023-07-20T14:59:52.529 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:52 smithi029 bash[104935]: audit 2023-07-20T14:59:51.228205+0000 mon.a (mon.0) 30 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-20T14:59:52.747 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Enabling cephadm module... 2023-07-20T14:59:52.747 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'cephadm'] 2023-07-20T14:59:52.747 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable cephadm 2023-07-20T14:59:53.445 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:53 smithi029 bash[104935]: audit 2023-07-20T14:59:52.125674+0000 mon.a (mon.0) 31 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-20T14:59:53.445 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:53 smithi029 bash[104935]: cluster 2023-07-20T14:59:52.228181+0000 mon.a (mon.0) 32 : cluster [DBG] mgrmap e4: y(active, since 2s) 2023-07-20T14:59:53.447 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:53 smithi029 bash[104935]: audit 2023-07-20T14:59:52.340394+0000 mon.a (mon.0) 33 : audit [DBG] from='client.? 172.21.15.29:0/4214347673' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-20T14:59:54.444 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:54 smithi029 bash[104935]: audit 2023-07-20T14:59:53.263884+0000 mon.a (mon.0) 34 : audit [INF] from='client.? 172.21.15.29:0/1542583085' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-07-20T14:59:54.445 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 14:59:54 smithi029 bash[105170]: ignoring --setuser ceph since I am not root 2023-07-20T14:59:54.445 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 14:59:54 smithi029 bash[105170]: ignoring --setgroup ceph since I am not root 2023-07-20T14:59:54.522 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2023-07-20T14:59:54.522 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2023-07-20T14:59:57.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T14:59:57.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 5, 2023-07-20T14:59:57.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14100, 2023-07-20T14:59:57.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2023-07-20T14:59:57.865 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2023-07-20T14:59:57.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2023-07-20T14:59:57.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T14:59:57.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2023-07-20T14:59:57.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.29:6800", 2023-07-20T14:59:57.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2412527169 2023-07-20T14:59:57.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:57.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T14:59:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2023-07-20T14:59:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.29:6801", 2023-07-20T14:59:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2412527169 2023-07-20T14:59:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T14:59:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2023-07-20T14:59:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.15.29:6801/2412527169", 2023-07-20T14:59:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2023-07-20T14:59:49.779178+0000", 2023-07-20T14:59:57.868 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2023-07-20T14:59:57.868 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2023-07-20T14:59:57.879 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2023-07-20T14:59:57.879 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2023-07-20T14:59:57.880 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2023-07-20T14:59:57.880 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2023-07-20T14:59:57.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2023-07-20T14:59:57.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:57.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2023-07-20T14:59:57.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T14:59:57.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2023-07-20T14:59:57.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T14:59:57.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T14:59:57.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T14:59:57.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2023-07-20T14:59:57.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2023-07-20T14:59:57.897 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T14:59:57.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:57.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:57.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2023-07-20T14:59:57.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:57.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:57.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:57.913 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2023-07-20T14:59:57.914 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:57.914 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:57.916 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:57.916 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:57.917 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T14:59:57.917 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T14:59:57.917 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:57.917 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:57.917 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:57.917 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T14:59:57.917 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:57.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:57.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T14:59:57.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T14:59:57.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T14:59:57.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T14:59:57.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T14:59:57.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T14:59:57.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T14:59:57.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:57.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:57.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:57.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:57.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:57.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:57.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T14:59:57.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T14:59:57.959 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:57.960 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:57.961 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:57.961 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T14:59:57.961 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:57.961 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:57.961 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:57.961 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:57.962 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:57.962 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:57.962 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:57.962 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:57.962 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T14:59:57.962 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T14:59:57.962 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:57.981 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:57.981 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:57.981 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T14:59:57.982 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:57.982 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:57.982 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T14:59:57.982 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T14:59:57.982 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T14:59:57.982 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T14:59:57.982 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T14:59:57.983 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T14:59:57.983 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T14:59:57.983 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:57.983 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:57.983 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:57.983 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:57.983 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:57.983 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.017 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T14:59:58.018 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T14:59:58.018 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:58.018 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.018 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.018 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T14:59:58.018 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.018 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:58.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2023-07-20T14:59:58.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2023-07-20T14:59:58.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T14:59:58.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2023-07-20T14:59:58.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2023-07-20T14:59:58.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2023-07-20T14:59:58.022 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.022 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.022 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.022 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2023-07-20T14:59:58.044 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.066 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.066 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.066 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2023-07-20T14:59:58.066 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.068 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.068 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.068 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.069 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2023-07-20T14:59:58.069 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2023-07-20T14:59:58.069 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.069 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.074 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.074 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T14:59:58.074 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.074 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2023-07-20T14:59:58.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2023-07-20T14:59:58.076 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2023-07-20T14:59:58.076 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.076 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.088 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.088 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T14:59:58.088 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.100 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2023-07-20T14:59:58.100 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.101 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.101 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.101 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.101 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2023-07-20T14:59:58.101 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2023-07-20T14:59:58.101 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T14:59:58.101 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.119 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.119 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2023-07-20T14:59:58.119 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.120 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.120 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.148 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2023-07-20T14:59:58.148 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.148 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.154 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.154 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.154 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2023-07-20T14:59:58.154 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2023-07-20T14:59:58.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T14:59:58.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2023-07-20T14:59:58.163 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.163 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.163 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.163 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.163 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2023-07-20T14:59:58.163 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2023-07-20T14:59:58.163 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:58.164 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.164 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.164 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:58.164 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.164 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2023-07-20T14:59:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.192 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.192 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2023-07-20T14:59:58.192 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2023-07-20T14:59:58.193 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.193 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.193 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.193 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T14:59:58.193 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.193 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.193 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2023-07-20T14:59:58.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T14:59:58.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T14:59:58.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T14:59:58.222 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2023-07-20T14:59:58.222 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T14:59:58.222 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T14:59:58.222 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T14:59:58.222 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2023-07-20T14:59:58.223 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2023-07-20T14:59:58.223 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:58.223 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.223 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.223 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T14:59:58.223 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.223 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.224 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.224 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2023-07-20T14:59:58.224 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.229 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.229 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.229 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2023-07-20T14:59:58.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2023-07-20T14:59:58.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2023-07-20T14:59:58.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2023-07-20T14:59:58.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2023-07-20T14:59:58.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.232 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2023-07-20T14:59:58.232 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2023-07-20T14:59:58.232 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2023-07-20T14:59:58.240 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.249 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.252 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2023-07-20T14:59:58.252 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2023-07-20T14:59:58.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2023-07-20T14:59:58.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2023-07-20T14:59:58.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-07-20T14:59:58.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2023-07-20T14:59:58.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2023-07-20T14:59:58.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2023-07-20T14:59:58.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2023-07-20T14:59:58.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2023-07-20T14:59:58.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2023-07-20T14:59:58.255 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.255 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2023-07-20T14:59:58.255 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.255 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.255 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.255 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.255 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2023-07-20T14:59:58.255 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2023-07-20T14:59:58.256 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.256 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.256 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2023-07-20T14:59:58.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.291 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2023-07-20T14:59:58.291 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-07-20T14:59:58.291 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.291 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.291 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.292 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2023-07-20T14:59:58.312 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2023-07-20T14:59:58.312 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2023-07-20T14:59:58.312 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.312 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.312 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2023-07-20T14:59:58.328 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2023-07-20T14:59:58.329 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2023-07-20T14:59:58.335 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.336 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2023-07-20T14:59:58.336 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-07-20T14:59:58.336 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.336 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.336 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.336 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2023-07-20T14:59:58.361 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2023-07-20T14:59:58.362 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.362 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.362 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.362 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2023-07-20T14:59:58.362 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.362 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.363 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.363 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2023-07-20T14:59:58.363 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2023-07-20T14:59:58.363 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.363 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.363 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.363 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2023-07-20T14:59:58.364 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2023-07-20T14:59:58.364 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2023-07-20T14:59:58.364 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.409 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.409 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2023-07-20T14:59:58.410 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2023-07-20T14:59:58.410 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2023-07-20T14:59:58.410 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.410 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-07-20T14:59:58.411 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-07-20T14:59:58.411 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.411 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.411 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.411 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T14:59:58.411 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T14:59:58.420 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.421 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.421 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.421 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T14:59:58.422 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.422 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.422 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T14:59:58.423 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T14:59:58.423 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T14:59:58.423 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T14:59:58.423 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T14:59:58.424 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T14:59:58.424 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T14:59:58.424 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:58.424 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:58.424 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.424 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.424 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.424 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.425 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T14:59:58.425 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T14:59:58.425 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:58.425 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.425 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.472 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T14:59:58.473 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.473 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.473 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.473 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:58.473 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.473 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.473 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.474 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.474 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T14:59:58.474 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T14:59:58.474 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.474 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.474 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.474 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T14:59:58.474 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.475 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.475 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T14:59:58.475 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T14:59:58.475 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T14:59:58.475 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T14:59:58.475 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T14:59:58.475 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T14:59:58.475 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T14:59:58.476 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:58.476 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:58.476 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.496 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.496 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.497 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.498 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T14:59:58.498 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T14:59:58.498 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:58.498 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.498 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.500 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T14:59:58.500 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.501 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.501 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.501 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:58.501 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.501 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.522 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.522 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.523 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2023-07-20T14:59:58.523 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2023-07-20T14:59:58.523 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2023-07-20T14:59:58.523 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.523 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.524 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2023-07-20T14:59:58.524 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.524 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.524 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.524 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2023-07-20T14:59:58.524 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.524 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.524 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2023-07-20T14:59:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2023-07-20T14:59:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2023-07-20T14:59:58.553 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.553 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.554 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T14:59:58.554 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2023-07-20T14:59:58.554 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2023-07-20T14:59:58.554 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2023-07-20T14:59:58.564 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:58.564 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2023-07-20T14:59:58.564 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.565 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.565 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.569 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.569 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2023-07-20T14:59:58.569 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2023-07-20T14:59:58.569 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.569 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T14:59:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2023-07-20T14:59:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.572 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.572 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2023-07-20T14:59:58.572 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2023-07-20T14:59:58.572 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T14:59:58.572 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.573 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.573 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2023-07-20T14:59:58.573 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.573 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.573 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.573 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2023-07-20T14:59:58.573 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.574 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.574 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.574 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.574 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2023-07-20T14:59:58.574 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2023-07-20T14:59:58.574 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T14:59:58.574 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.574 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.575 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2023-07-20T14:59:58.575 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2023-07-20T14:59:58.575 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.575 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.575 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2023-07-20T14:59:58.575 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-07-20T14:59:58.575 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.575 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.576 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.576 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2023-07-20T14:59:58.576 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2023-07-20T14:59:58.585 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2023-07-20T14:59:58.586 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.586 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.586 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2023-07-20T14:59:58.586 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.586 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.586 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.586 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2023-07-20T14:59:58.587 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.587 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.587 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.587 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T14:59:58.587 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T14:59:58.587 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.587 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T14:59:58.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2023-07-20T14:59:58.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T14:59:58.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T14:59:58.634 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T14:59:58.634 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2023-07-20T14:59:58.634 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2023-07-20T14:59:58.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:58.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.644 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T14:59:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2023-07-20T14:59:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-07-20T14:59:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.646 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.646 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.646 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2023-07-20T14:59:58.646 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2023-07-20T14:59:58.646 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.646 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.646 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.646 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2023-07-20T14:59:58.647 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.647 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.664 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.664 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2023-07-20T14:59:58.664 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.664 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.664 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.664 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.665 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2023-07-20T14:59:58.665 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2023-07-20T14:59:58.665 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T14:59:58.681 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:58.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2023-07-20T14:59:58.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2023-07-20T14:59:58.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.683 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.683 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.683 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.683 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2023-07-20T14:59:58.683 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2023-07-20T14:59:58.683 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T14:59:58.683 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.684 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:58.684 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2023-07-20T14:59:58.684 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.684 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.684 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.684 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2023-07-20T14:59:58.684 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.684 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.685 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.685 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.685 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2023-07-20T14:59:58.685 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2023-07-20T14:59:58.685 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T14:59:58.685 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.685 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:58.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2023-07-20T14:59:58.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.717 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2023-07-20T14:59:58.718 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.718 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.718 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.718 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.718 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T14:59:58.718 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T14:59:58.718 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.731 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.731 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.731 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T14:59:58.731 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.731 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.732 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T14:59:58.774 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T14:59:58.774 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T14:59:58.774 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T14:59:58.774 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T14:59:58.774 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T14:59:58.774 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T14:59:58.779 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:58.789 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:58.789 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.789 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.789 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T14:59:58.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T14:59:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2023-07-20T14:59:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T14:59:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T14:59:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T14:59:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.800 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T14:59:58.800 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T14:59:58.800 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T14:59:58.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T14:59:58.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T14:59:58.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T14:59:58.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T14:59:58.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T14:59:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T14:59:58.846 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:58.846 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.847 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:58.847 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T14:59:58.847 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.847 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.847 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.847 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:58.847 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.848 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.848 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.848 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.848 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2023-07-20T14:59:58.848 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2023-07-20T14:59:58.848 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.848 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.849 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:58.849 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2023-07-20T14:59:58.849 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.849 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.849 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T14:59:58.849 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2023-07-20T14:59:58.849 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2023-07-20T14:59:58.849 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:58.850 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2023-07-20T14:59:58.850 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.903 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.904 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.904 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.905 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2023-07-20T14:59:58.905 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2023-07-20T14:59:58.917 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:58.917 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.917 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:58.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T14:59:58.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2023-07-20T14:59:58.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2023-07-20T14:59:58.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2023-07-20T14:59:58.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:58.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:58.920 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:58.920 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.920 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.942 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.942 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2023-07-20T14:59:58.942 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.943 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.943 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.943 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.954 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2023-07-20T14:59:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2023-07-20T14:59:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:58.956 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.956 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.956 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.956 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-07-20T14:59:58.956 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.956 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.956 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.957 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:58.957 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2023-07-20T14:59:58.957 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2023-07-20T14:59:58.957 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:58.957 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:58.957 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:58.957 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:58.957 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:58.958 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:58.958 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:58.958 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-07-20T14:59:58.958 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:58.958 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:58.958 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:58.990 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T14:59:58.990 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T14:59:59.010 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.010 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T14:59:59.010 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2023-07-20T14:59:59.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T14:59:59.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T14:59:59.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T14:59:59.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T14:59:59.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T14:59:59.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:59.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:59.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T14:59:59.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T14:59:59.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T14:59:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T14:59:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T14:59:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T14:59:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T14:59:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T14:59:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T14:59:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T14:59:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T14:59:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.082 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.082 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.082 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.108 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.108 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.109 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.121 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T14:59:59.121 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T14:59:59.121 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:59.121 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.121 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:59.129 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T14:59:59.133 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.133 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.134 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T14:59:59.134 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T14:59:59.134 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T14:59:59.134 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T14:59:59.134 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T14:59:59.134 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T14:59:59.134 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T14:59:59.135 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T14:59:59.135 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.135 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.135 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.135 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.135 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.135 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T14:59:59.135 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T14:59:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T14:59:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.137 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.137 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.137 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.137 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.185 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2023-07-20T14:59:59.185 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2023-07-20T14:59:59.186 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T14:59:59.186 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.186 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:59.188 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2023-07-20T14:59:59.188 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.188 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.188 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.190 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2023-07-20T14:59:59.190 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.191 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.191 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.191 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.191 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2023-07-20T14:59:59.191 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2023-07-20T14:59:59.191 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T14:59:59.191 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.192 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T14:59:59.192 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2023-07-20T14:59:59.229 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2023-07-20T14:59:59.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T14:59:59.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T14:59:59.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T14:59:59.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2023-07-20T14:59:59.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T14:59:59.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T14:59:59.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T14:59:59.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2023-07-20T14:59:59.232 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2023-07-20T14:59:59.232 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:59.232 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.238 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.238 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T14:59:59.238 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.238 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.238 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.239 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.239 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.239 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.240 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.240 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.240 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2023-07-20T14:59:59.240 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2023-07-20T14:59:59.240 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.251 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.251 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.271 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T14:59:59.271 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.272 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.272 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.272 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.284 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.286 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2023-07-20T14:59:59.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2023-07-20T14:59:59.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:59.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.290 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.290 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.290 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.290 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.290 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.290 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.292 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2023-07-20T14:59:59.292 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2023-07-20T14:59:59.292 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.292 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.293 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.293 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:59.293 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.293 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.293 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.293 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.313 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.313 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.313 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.313 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.313 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2023-07-20T14:59:59.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2023-07-20T14:59:59.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:59.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2023-07-20T14:59:59.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2023-07-20T14:59:59.316 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.316 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.316 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.316 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:59.316 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.316 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2023-07-20T14:59:59.318 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2023-07-20T14:59:59.318 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.318 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.346 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.346 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:59.346 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.346 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.346 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.347 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.347 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.347 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.347 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.347 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.347 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2023-07-20T14:59:59.347 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2023-07-20T14:59:59.347 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.348 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.348 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.348 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:59.352 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.353 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.353 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.353 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.353 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.353 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.353 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.354 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.354 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2023-07-20T14:59:59.355 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2023-07-20T14:59:59.355 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.355 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.356 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.356 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:59.356 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.356 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.356 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.356 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.356 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.356 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2023-07-20T14:59:59.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2023-07-20T14:59:59.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:59.358 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.360 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.360 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.383 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-07-20T14:59:59.383 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-07-20T14:59:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T14:59:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2023-07-20T14:59:59.403 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2023-07-20T14:59:59.408 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:59.408 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.408 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.408 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2023-07-20T14:59:59.408 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.409 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.409 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.409 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.409 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2023-07-20T14:59:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2023-07-20T14:59:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.414 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.414 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.414 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:59.414 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.414 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.414 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.414 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.415 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.415 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.415 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.415 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2023-07-20T14:59:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2023-07-20T14:59:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.460 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T14:59:59.460 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.460 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.460 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.460 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.461 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.461 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.474 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.474 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.475 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2023-07-20T14:59:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2023-07-20T14:59:59.512 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:59.512 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.513 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.513 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2023-07-20T14:59:59.513 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.513 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.513 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.513 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.514 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.514 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.514 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.514 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.514 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2023-07-20T14:59:59.514 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-07-20T14:59:59.514 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.514 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.515 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.515 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T14:59:59.515 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.515 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.515 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.515 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.515 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.515 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.516 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.516 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.516 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2023-07-20T14:59:59.534 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2023-07-20T14:59:59.534 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.534 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.534 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.535 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:59.536 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.536 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.536 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.536 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.536 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.536 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.536 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2023-07-20T14:59:59.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2023-07-20T14:59:59.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:59.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T14:59:59.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-07-20T14:59:59.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-07-20T14:59:59.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T14:59:59.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.540 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.540 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.562 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.580 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.580 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-07-20T14:59:59.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-07-20T14:59:59.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T14:59:59.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.645 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.645 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.645 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.674 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-07-20T14:59:59.674 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-07-20T14:59:59.674 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.674 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.674 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.676 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.676 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.676 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-07-20T14:59:59.704 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-07-20T14:59:59.704 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.704 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.705 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.713 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:59.713 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.713 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.713 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.720 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.721 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.722 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.722 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.722 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.722 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-07-20T14:59:59.722 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-07-20T14:59:59.722 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.722 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.723 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.723 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T14:59:59.723 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.723 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.723 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.723 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.723 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.723 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.724 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.724 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.744 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-07-20T14:59:59.745 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-07-20T14:59:59.745 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.745 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.745 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.745 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T14:59:59.746 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.754 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.754 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-07-20T14:59:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-07-20T14:59:59.756 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.756 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.756 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T14:59:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2023-07-20T14:59:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2023-07-20T14:59:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2023-07-20T14:59:59.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2023-07-20T14:59:59.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:59.792 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.792 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.792 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-07-20T14:59:59.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2023-07-20T14:59:59.812 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-07-20T14:59:59.812 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T14:59:59.812 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.812 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.812 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2023-07-20T14:59:59.812 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.812 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.813 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.813 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.813 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.813 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2023-07-20T14:59:59.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2023-07-20T14:59:59.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T14:59:59.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2023-07-20T14:59:59.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2023-07-20T14:59:59.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2023-07-20T14:59:59.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T14:59:59.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2023-07-20T14:59:59.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.849 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.849 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.849 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.849 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.849 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.861 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2023-07-20T14:59:59.861 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2023-07-20T14:59:59.861 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:59.861 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.861 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.861 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T14:59:59.861 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.862 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.862 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.862 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.862 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.862 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.862 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.862 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2023-07-20T14:59:59.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2023-07-20T14:59:59.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:59.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2023-07-20T14:59:59.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.864 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.864 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.864 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.864 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.864 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2023-07-20T14:59:59.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2023-07-20T14:59:59.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:59.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T14:59:59.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.921 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.921 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.925 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.925 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2023-07-20T14:59:59.932 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2023-07-20T14:59:59.932 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T14:59:59.932 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.933 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.933 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2023-07-20T14:59:59.933 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.933 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.933 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.933 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.933 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.934 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.934 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2023-07-20T14:59:59.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2023-07-20T14:59:59.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:59.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2023-07-20T14:59:59.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.952 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.952 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.952 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.963 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.964 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2023-07-20T14:59:59.964 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2023-07-20T14:59:59.964 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:59.964 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.965 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.966 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T14:59:59.968 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.968 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.968 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2023-07-20T14:59:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2023-07-20T14:59:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T14:59:59.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T14:59:59.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T14:59:59.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T14:59:59.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T14:59:59.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T14:59:59.988 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T14:59:59.988 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T14:59:59.988 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T14:59:59.989 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T14:59:59.989 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T14:59:59.989 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2023-07-20T14:59:59.989 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2023-07-20T14:59:59.989 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T14:59:59.990 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T14:59:59.990 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:00.001 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:00.001 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2023-07-20T15:00:00.003 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2023-07-20T15:00:00.003 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:00.040 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.041 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:00.041 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2023-07-20T15:00:00.042 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.042 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.042 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.042 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.042 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.042 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.043 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.043 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.043 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2023-07-20T15:00:00.043 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-07-20T15:00:00.043 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:00.043 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.043 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:00.043 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2023-07-20T15:00:00.044 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.044 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.044 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.048 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.049 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.049 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.049 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.049 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.049 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2023-07-20T15:00:00.049 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-07-20T15:00:00.049 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:00.050 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.050 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:00.069 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2023-07-20T15:00:00.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2023-07-20T15:00:00.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2023-07-20T15:00:00.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:00.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:00.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:00.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.072 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.072 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.072 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.072 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.072 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.072 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.072 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2023-07-20T15:00:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2023-07-20T15:00:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.074 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.074 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2023-07-20T15:00:00.074 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.074 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.074 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.074 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.074 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2023-07-20T15:00:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2023-07-20T15:00:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2023-07-20T15:00:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.076 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.076 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.076 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.127 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.127 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.127 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2023-07-20T15:00:00.127 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2023-07-20T15:00:00.127 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:00.127 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.127 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:00.128 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:00.156 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.157 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.157 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.157 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.157 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.157 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.157 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.157 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:00.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:00.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:00.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:00.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:00.188 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.189 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.189 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:00.189 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:00.189 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:00.189 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:00.189 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:00.190 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:00.190 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:00.190 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:00.190 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.214 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.214 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:00.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:00.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:00.216 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.216 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:00.216 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:00.216 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.216 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.216 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.216 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.217 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.217 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.217 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.217 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.217 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:00.217 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:00.217 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:00.217 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:00.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:00.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:00.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:00.258 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:00.258 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:00.259 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:00.259 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:00.259 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:00.259 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:00.259 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:00.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:00.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:00.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.261 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:00.261 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:00.261 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.261 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.261 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.261 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.261 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.261 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.262 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.262 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.262 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2023-07-20T15:00:00.262 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2023-07-20T15:00:00.262 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:00.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:00.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:00.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.318 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.318 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.318 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2023-07-20T15:00:00.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2023-07-20T15:00:00.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:00.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:00.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2023-07-20T15:00:00.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2023-07-20T15:00:00.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2023-07-20T15:00:00.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:00.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:00.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2023-07-20T15:00:00.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.368 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.368 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.368 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.391 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.392 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.392 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2023-07-20T15:00:00.403 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2023-07-20T15:00:00.403 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:00.449 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.450 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:00.450 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:00.450 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.450 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.450 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.450 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.450 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2023-07-20T15:00:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2023-07-20T15:00:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.452 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:00.452 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2023-07-20T15:00:00.479 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.479 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.480 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.480 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.480 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.480 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.480 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.485 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2023-07-20T15:00:00.486 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2023-07-20T15:00:00.486 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:00.486 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.486 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:00.486 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2023-07-20T15:00:00.486 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.486 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.486 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:00.487 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:00.487 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2023-07-20T15:00:00.487 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:00.489 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.490 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.490 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.490 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.490 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.490 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2023-07-20T15:00:00.490 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2023-07-20T15:00:00.490 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:00.491 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.491 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:00.491 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2023-07-20T15:00:00.512 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2023-07-20T15:00:00.512 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2023-07-20T15:00:00.512 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.512 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.521 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.521 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.521 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.521 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.561 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2023-07-20T15:00:00.591 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2023-07-20T15:00:00.591 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:00.592 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.592 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:00.595 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:00.596 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.596 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.596 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.596 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.597 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.597 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.597 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.597 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.597 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2023-07-20T15:00:00.597 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2023-07-20T15:00:00.597 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:00.597 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.598 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:00.598 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:00.598 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.598 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.598 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.598 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.598 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.629 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.629 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.630 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:00.630 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:00.630 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.630 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:00.630 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2023-07-20T15:00:00.630 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:00.630 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:00.631 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:00.631 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2023-07-20T15:00:00.631 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2023-07-20T15:00:00.631 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:00.631 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.631 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:00.631 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:00.631 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.632 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.632 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.632 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2023-07-20T15:00:00.655 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.655 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.655 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.655 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.656 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:00.656 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:00.656 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:00.666 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.666 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:00.666 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:00.668 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:00.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:00.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:00.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:00.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:00.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:00.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:00.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:00.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.671 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.671 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:00.742 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:00.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:00.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:00.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:00.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.744 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.744 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.744 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.744 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.744 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.744 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:00.744 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:00.745 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:00.745 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.745 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:00.745 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:00.745 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.745 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.745 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:00.745 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:00.746 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:00.746 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:00.746 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:00.746 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:00.746 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:00.746 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:00.746 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.747 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:00.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:00.784 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:00.784 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.784 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2023-07-20T15:00:00.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2023-07-20T15:00:00.796 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:00.797 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.797 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:00.797 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2023-07-20T15:00:00.797 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.797 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2023-07-20T15:00:00.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2023-07-20T15:00:00.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2023-07-20T15:00:00.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:00.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:00.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2023-07-20T15:00:00.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.800 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.800 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2023-07-20T15:00:00.800 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.844 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.844 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.844 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2023-07-20T15:00:00.844 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2023-07-20T15:00:00.844 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:00.844 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.844 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:00.845 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2023-07-20T15:00:00.875 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.875 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.875 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.875 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2023-07-20T15:00:00.876 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.876 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.876 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.876 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.876 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2023-07-20T15:00:00.876 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2023-07-20T15:00:00.876 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:00.877 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.877 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:00.877 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2023-07-20T15:00:00.877 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.877 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.877 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.877 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2023-07-20T15:00:00.877 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.878 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.878 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.878 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.878 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2023-07-20T15:00:00.878 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2023-07-20T15:00:00.878 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:00.878 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.922 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:00.922 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:00.923 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.923 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.923 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.923 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2023-07-20T15:00:00.923 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.923 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.923 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.924 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.924 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2023-07-20T15:00:00.924 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2023-07-20T15:00:00.925 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:00.925 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.925 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2023-07-20T15:00:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.935 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.936 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2023-07-20T15:00:00.936 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.947 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.947 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.947 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.947 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2023-07-20T15:00:00.948 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2023-07-20T15:00:00.948 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:00.948 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:00.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2023-07-20T15:00:00.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:00.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:00.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:00.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2023-07-20T15:00:00.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:00.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:00.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:00.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:00.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:00.993 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:00.993 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:00.993 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2023-07-20T15:00:00.993 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:00.993 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:00.994 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:00.994 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:00.994 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:00.994 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:00.994 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:00.994 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:00.995 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:01.014 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.014 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.014 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:01.014 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:01.014 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:01.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:01.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:01.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:01.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:01.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:01.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.026 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.026 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.027 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.027 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.027 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:01.059 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:01.060 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:01.068 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.068 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.068 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:01.069 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.069 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.069 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.069 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.069 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:01.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:01.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:01.084 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:01.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:01.116 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.116 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.116 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.116 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.117 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.117 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:01.117 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:01.117 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:01.117 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.117 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.117 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:01.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.119 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2023-07-20T15:00:01.119 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2023-07-20T15:00:01.119 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.119 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.119 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:01.153 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2023-07-20T15:00:01.154 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.154 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.154 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.154 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2023-07-20T15:00:01.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2023-07-20T15:00:01.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.156 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:01.156 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2023-07-20T15:00:01.165 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.165 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.165 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.166 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.166 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.166 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.166 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.180 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.181 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2023-07-20T15:00:01.181 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2023-07-20T15:00:01.187 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.213 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.213 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:01.214 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2023-07-20T15:00:01.214 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.214 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.214 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.214 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.214 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.214 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.214 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:01.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:01.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:01.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2023-07-20T15:00:01.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2023-07-20T15:00:01.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2023-07-20T15:00:01.216 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:01.216 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2023-07-20T15:00:01.216 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2023-07-20T15:00:01.228 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.228 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.228 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:01.229 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2023-07-20T15:00:01.229 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.229 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.235 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.236 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2023-07-20T15:00:01.236 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2023-07-20T15:00:01.236 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.236 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.236 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:01.236 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2023-07-20T15:00:01.236 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.237 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.237 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.237 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.237 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.237 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.255 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.256 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.256 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2023-07-20T15:00:01.256 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2023-07-20T15:00:01.256 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.257 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.257 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:01.257 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:01.257 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.257 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.257 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.258 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2023-07-20T15:00:01.279 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2023-07-20T15:00:01.279 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.279 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.279 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:01.280 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2023-07-20T15:00:01.280 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.280 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.280 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.280 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.280 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.280 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.280 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:01.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:01.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:01.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:01.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:01.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:01.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:01.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:01.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:01.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:01.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:01.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:01.284 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:01.285 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:01.285 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.286 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.286 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:01.286 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.286 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.286 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.286 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.287 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.287 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.287 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.287 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.287 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:01.287 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:01.287 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:01.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:01.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:01.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:01.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:01.326 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:01.326 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:01.326 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:01.326 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:01.327 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.327 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.327 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.327 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.327 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.327 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:01.327 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:01.328 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:01.328 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.328 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.329 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:01.329 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.330 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.330 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.330 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2023-07-20T15:00:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2023-07-20T15:00:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.371 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.371 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.371 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.371 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.371 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.371 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2023-07-20T15:00:01.371 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2023-07-20T15:00:01.372 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.372 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.372 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:01.378 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2023-07-20T15:00:01.378 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.378 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2023-07-20T15:00:01.380 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2023-07-20T15:00:01.380 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.399 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.410 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:01.410 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2023-07-20T15:00:01.410 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.410 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.410 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.410 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.411 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.411 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.411 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.411 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.411 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2023-07-20T15:00:01.411 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2023-07-20T15:00:01.411 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.412 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.412 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:01.412 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2023-07-20T15:00:01.428 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.428 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.428 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.428 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.457 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.457 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.457 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.463 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.464 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2023-07-20T15:00:01.464 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2023-07-20T15:00:01.464 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.464 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.464 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:01.464 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:01.464 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.465 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.465 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.465 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.465 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.465 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.465 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.465 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.465 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2023-07-20T15:00:01.466 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2023-07-20T15:00:01.466 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.466 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.466 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:01.494 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2023-07-20T15:00:01.495 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.495 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.495 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.495 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.495 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.496 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.496 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.496 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:01.496 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:01.496 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.496 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:01.497 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2023-07-20T15:00:01.497 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:01.497 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:01.497 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:01.511 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:01.511 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:01.511 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.511 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.512 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.512 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:01.512 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.512 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.512 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:01.512 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:01.513 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:01.513 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:01.513 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:01.513 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:01.513 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:01.513 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:01.513 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.513 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.514 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.514 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.514 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.514 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:01.568 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:01.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:01.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:01.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.572 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.572 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.614 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.617 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:01.617 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:01.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.637 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.638 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.666 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:01.666 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.666 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.666 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:01.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:01.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:01.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:01.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:01.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:01.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:01.668 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:01.668 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.668 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.668 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.668 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.668 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.668 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:01.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:01.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:01.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:01.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.744 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.744 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.748 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:01.777 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:01.777 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.793 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:01.794 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2023-07-20T15:00:01.794 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:01.794 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:01.794 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:01.794 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:01.794 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:01.795 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.795 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.795 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.795 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:01.795 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.795 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.795 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:01.796 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:01.796 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:01.812 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:01.812 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:01.812 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:01.813 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:01.813 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:01.813 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.813 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.813 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.813 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.813 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.813 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:01.814 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:01.814 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:01.814 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.814 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.814 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:01.814 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.814 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.814 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.815 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.815 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.815 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.815 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.815 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.815 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:01.815 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:01.815 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.816 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.816 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.818 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:01.819 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.819 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.819 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:01.819 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:01.820 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:01.820 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:01.820 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:01.820 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:01.820 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:01.820 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:01.820 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.820 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:01.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:01.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:01.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:01.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:01.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:01.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:01.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2023-07-20T15:00:01.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:01.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:01.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:01.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2023-07-20T15:00:01.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2023-07-20T15:00:01.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:01.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:01.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2023-07-20T15:00:01.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.825 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.825 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.825 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2023-07-20T15:00:01.825 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.825 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.825 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.825 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.826 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2023-07-20T15:00:01.826 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2023-07-20T15:00:01.826 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:01.826 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.826 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:01.826 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2023-07-20T15:00:01.826 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2023-07-20T15:00:01.826 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.827 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.827 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2023-07-20T15:00:01.837 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.840 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.859 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.859 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.859 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:01.878 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:01.880 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.880 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.881 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.881 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:01.881 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.881 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.881 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:01.881 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:01.881 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:01.881 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:01.882 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:01.882 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:01.882 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:01.882 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:01.882 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.882 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.882 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:01.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:01.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:01.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:01.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.902 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.903 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:01.903 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.918 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:01.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:01.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:01.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:01.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:01.919 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:01.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:01.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.952 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.952 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:01.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:01.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:01.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:01.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2023-07-20T15:00:01.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:01.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:01.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:01.971 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2023-07-20T15:00:01.971 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2023-07-20T15:00:02.025 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:02.025 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.026 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.026 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2023-07-20T15:00:02.026 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.026 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.026 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.026 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2023-07-20T15:00:02.027 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.027 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.027 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.027 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.027 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:02.027 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:02.027 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:02.028 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.037 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.038 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:02.038 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.054 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:02.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:02.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:02.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:02.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:02.056 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:02.056 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:02.056 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:02.056 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.056 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.056 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.103 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.103 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.103 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:02.103 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:02.104 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:02.104 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.105 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.105 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:02.105 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.105 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.105 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.105 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.105 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.106 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.106 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:02.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:02.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:02.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:02.160 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.161 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.161 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:02.161 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:02.161 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:02.163 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:02.163 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:02.163 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:02.163 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:02.163 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:02.164 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.164 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.164 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.164 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.164 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2023-07-20T15:00:02.167 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2023-07-20T15:00:02.167 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:02.167 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.167 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.167 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:02.167 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.167 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.168 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.168 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2023-07-20T15:00:02.168 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.168 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2023-07-20T15:00:02.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2023-07-20T15:00:02.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:02.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2023-07-20T15:00:02.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2023-07-20T15:00:02.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2023-07-20T15:00:02.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2023-07-20T15:00:02.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:02.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2023-07-20T15:00:02.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2023-07-20T15:00:02.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2023-07-20T15:00:02.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2023-07-20T15:00:02.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:02.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:02.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.192 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.192 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.214 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2023-07-20T15:00:02.214 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.215 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.229 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.229 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2023-07-20T15:00:02.245 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2023-07-20T15:00:02.245 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:02.245 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.245 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.245 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2023-07-20T15:00:02.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.252 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2023-07-20T15:00:02.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:02.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:02.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:02.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2023-07-20T15:00:02.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:02.255 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:02.255 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:02.255 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:02.256 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:02.256 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:02.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:02.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.290 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.290 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:02.290 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:02.290 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:02.290 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:02.290 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:02.290 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:02.290 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:02.291 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:02.291 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.291 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.291 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.291 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.291 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.291 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:02.292 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:02.292 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:02.292 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:02.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:02.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:02.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:02.340 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.340 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:02.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:02.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:02.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:02.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:02.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:02.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:02.371 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:02.371 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:02.371 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.371 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.371 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.371 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.371 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.372 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:02.372 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:02.381 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:02.381 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.382 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.382 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:02.382 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.395 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.395 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.396 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.396 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.396 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.396 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.396 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.396 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2023-07-20T15:00:02.396 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2023-07-20T15:00:02.397 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:02.489 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.489 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.490 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:02.490 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.490 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.490 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:02.490 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2023-07-20T15:00:02.490 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2023-07-20T15:00:02.490 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2023-07-20T15:00:02.491 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:02.491 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2023-07-20T15:00:02.491 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.491 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.491 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.491 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:02.505 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:02.506 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.506 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:02.506 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2023-07-20T15:00:02.506 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:02.506 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:02.506 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:02.506 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:02.507 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:02.507 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:02.507 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.507 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.507 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:02.507 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.507 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.507 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:02.508 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:02.508 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:02.508 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:02.545 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:02.546 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:02.546 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:02.546 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:02.546 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.546 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.546 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.546 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.546 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:02.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:02.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:02.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:02.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.548 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.548 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.548 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.576 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.577 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.577 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.577 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.579 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:02.579 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:02.579 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:02.579 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.579 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.580 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:02.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:02.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:02.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:02.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:02.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:02.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:02.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:02.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:02.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.624 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:02.624 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:02.624 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:02.624 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.624 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.624 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:02.624 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.625 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.625 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.625 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.625 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.625 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.625 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.625 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:02.625 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:02.626 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.626 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:02.626 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2023-07-20T15:00:02.626 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:02.626 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:02.626 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:02.626 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:02.627 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:02.627 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:02.627 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.627 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.627 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:02.627 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.627 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.627 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:02.628 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:02.628 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:02.628 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:02.653 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:02.654 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:02.654 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:02.654 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:02.654 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.654 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.654 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.654 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.655 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.655 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:02.655 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:02.655 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:02.655 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.655 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.655 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:02.655 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.656 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.656 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.668 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.668 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:02.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:02.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:02.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:02.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:02.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:02.671 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:02.681 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:02.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:02.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:02.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:02.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:02.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.683 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.683 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.683 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:02.683 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:02.683 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:02.683 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.683 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.683 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:02.684 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.684 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.688 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.689 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.689 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.689 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.690 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.690 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.690 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2023-07-20T15:00:02.690 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2023-07-20T15:00:02.690 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:02.690 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.690 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:02.691 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2023-07-20T15:00:02.691 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.691 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.691 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.691 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.691 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.691 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.691 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.692 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:02.692 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:02.692 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.692 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:02.692 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2023-07-20T15:00:02.692 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:02.692 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:02.692 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:02.693 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:02.693 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:02.693 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:02.693 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.693 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.693 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:02.693 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.693 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.694 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:02.694 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:02.694 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:02.694 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:02.694 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:02.694 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:02.694 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:02.694 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:02.695 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.695 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.695 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.695 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.695 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:02.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:02.719 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:02.719 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.719 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.719 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:02.719 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.720 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.720 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.720 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:02.760 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:02.761 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:02.761 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.778 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.779 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:02.779 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.779 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.779 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:02.779 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:02.779 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:02.780 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:02.780 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:02.780 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:02.780 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:02.780 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.784 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.784 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.784 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.809 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2023-07-20T15:00:02.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2023-07-20T15:00:02.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:02.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2023-07-20T15:00:02.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2023-07-20T15:00:02.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2023-07-20T15:00:02.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2023-07-20T15:00:02.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:02.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2023-07-20T15:00:02.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2023-07-20T15:00:02.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:02.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:02.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:02.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2023-07-20T15:00:02.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:02.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:02.837 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:02.837 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:02.837 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:02.837 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:02.837 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.837 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.884 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:02.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:02.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:02.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:02.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:02.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:02.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:02.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:02.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:02.908 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.909 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.909 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.909 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.909 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.909 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:02.909 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:02.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:02.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:02.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:02.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:02.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:02.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:02.912 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.912 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.940 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:02.940 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.940 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:02.940 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:02.940 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:02.941 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:02.941 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:02.941 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:02.941 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:02.941 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:02.941 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:02.941 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:02.942 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:02.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:02.979 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:02.979 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:02.979 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:02.981 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:02.981 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:02.981 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:02.981 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:02.981 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:02.981 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:02.982 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.102 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.113 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.113 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.113 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.113 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.114 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.114 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2023-07-20T15:00:03.114 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2023-07-20T15:00:03.114 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.114 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.114 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:03.114 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:03.114 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.115 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.115 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.115 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.115 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.115 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.115 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.115 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.115 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2023-07-20T15:00:03.116 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2023-07-20T15:00:03.116 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.127 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.128 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:03.128 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:03.128 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.128 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.128 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.128 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.129 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.129 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.129 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.129 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.129 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2023-07-20T15:00:03.129 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2023-07-20T15:00:03.129 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.129 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.130 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:03.130 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:03.130 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.130 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.130 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.130 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.130 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.130 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.131 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.131 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.131 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2023-07-20T15:00:03.131 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2023-07-20T15:00:03.131 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.131 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.131 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:03.131 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:03.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2023-07-20T15:00:03.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2023-07-20T15:00:03.207 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.207 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.207 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:03.207 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:03.207 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.207 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.207 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.207 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.208 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.208 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.226 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.227 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:03.227 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:03.227 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.227 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:03.228 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2023-07-20T15:00:03.228 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:03.228 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:03.228 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:03.228 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:03.228 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:03.228 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.229 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.229 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:03.229 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:03.229 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.229 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.240 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:03.240 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:03.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:03.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:03.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:03.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:03.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:03.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:03.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.249 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.249 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.249 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:03.249 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:03.249 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:03.249 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.249 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:03.250 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:03.250 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.250 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.257 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.257 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.257 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.272 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.272 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.276 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:03.276 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:03.276 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.276 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.276 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:03.277 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:03.277 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.278 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.286 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:03.287 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:03.287 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:03.287 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:03.287 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:03.287 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:03.287 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:03.287 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:03.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:03.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:03.288 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:03.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:03.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:03.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.289 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.349 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.349 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.349 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.349 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2023-07-20T15:00:03.349 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2023-07-20T15:00:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.351 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.351 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.351 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.351 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.351 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2023-07-20T15:00:03.351 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2023-07-20T15:00:03.351 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.351 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.352 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:03.352 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:03.387 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.387 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.387 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.387 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.388 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.388 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.388 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.388 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:03.388 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:03.388 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.388 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2023-07-20T15:00:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2023-07-20T15:00:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2023-07-20T15:00:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:03.412 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.413 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.413 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:03.413 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:03.413 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:03.413 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:03.414 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:03.414 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:03.414 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:03.414 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:03.414 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.415 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.416 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.416 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.416 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.416 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:03.416 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:03.417 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:03.417 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.417 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:03.417 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:03.417 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.417 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.417 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.418 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.418 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.418 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.418 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.418 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.418 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:03.418 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:03.418 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.419 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.419 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:03.419 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:03.419 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.419 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.419 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:03.419 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:03.419 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:03.420 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:03.420 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:03.420 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:03.421 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:03.421 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:03.421 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.421 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.422 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.422 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.422 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.422 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:03.422 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:03.422 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:03.422 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.423 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:03.423 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:03.423 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.423 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.423 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.423 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.423 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.465 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.466 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.466 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.466 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2023-07-20T15:00:03.466 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2023-07-20T15:00:03.468 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.468 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.468 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:03.468 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:03.468 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.469 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.469 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.469 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.469 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.469 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.469 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.469 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.469 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2023-07-20T15:00:03.470 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2023-07-20T15:00:03.470 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.473 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.474 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:03.477 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:03.477 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.477 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.478 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.478 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.478 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.478 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.479 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.479 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:03.479 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:03.479 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.479 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:03.479 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2023-07-20T15:00:03.513 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:03.513 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:03.513 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:03.514 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:03.514 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:03.514 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.514 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.514 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:03.516 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:03.516 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:03.516 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:03.530 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:03.530 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.531 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:03.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:03.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:03.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.540 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:03.540 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:03.540 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.540 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.540 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.540 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.540 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.541 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.541 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.541 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.541 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:03.541 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:03.541 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.541 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.562 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:03.562 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:03.563 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.563 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.563 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:03.563 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:03.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:03.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:03.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:03.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:03.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:03.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:03.624 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.624 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.624 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.624 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.624 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.624 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:03.624 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:03.666 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:03.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:03.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:03.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.702 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.702 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.702 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.702 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.702 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.702 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:03.702 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:03.703 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.703 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2023-07-20T15:00:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.724 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:03.724 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:03.744 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.745 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.745 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:03.745 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:03.745 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:03.748 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:03.749 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:03.749 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:03.749 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:03.749 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:03.749 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.749 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.749 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.750 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.750 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.750 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:03.750 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:03.751 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:03.751 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.762 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:03.762 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:03.762 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.762 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.762 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.762 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:03.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:03.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.831 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.831 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:03.831 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:03.893 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:03.893 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:03.893 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:03.893 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:03.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:03.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:03.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.912 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:03.913 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:03.920 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:03.920 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.926 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:03.926 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:03.926 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.926 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.927 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.927 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:03.927 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:03.974 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:03.974 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:03.974 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:03.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2023-07-20T15:00:03.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2023-07-20T15:00:03.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:03.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:03.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:03.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:03.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:03.976 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:03.976 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:03.976 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.025 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.025 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.025 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.025 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.025 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2023-07-20T15:00:04.025 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2023-07-20T15:00:04.040 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:04.050 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:04.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2023-07-20T15:00:04.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:04.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.052 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.052 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.052 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.052 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2023-07-20T15:00:04.052 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2023-07-20T15:00:04.052 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:04.052 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:04.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:04.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:04.054 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.054 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.054 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.054 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.054 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.054 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2023-07-20T15:00:04.054 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2023-07-20T15:00:04.054 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:04.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:04.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:04.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:04.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.056 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.056 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.056 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2023-07-20T15:00:04.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2023-07-20T15:00:04.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2023-07-20T15:00:04.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:04.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:04.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.099 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.099 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:04.099 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.099 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.099 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.099 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.100 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.100 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2023-07-20T15:00:04.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2023-07-20T15:00:04.128 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:04.128 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.129 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:04.129 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:04.129 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.129 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.130 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:04.157 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.157 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.157 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2023-07-20T15:00:04.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2023-07-20T15:00:04.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:04.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.211 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:04.245 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:04.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:04.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2023-07-20T15:00:04.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2023-07-20T15:00:04.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:04.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:04.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:04.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.404 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:04.404 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.405 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.411 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.412 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.412 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.412 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2023-07-20T15:00:04.412 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2023-07-20T15:00:04.412 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:04.484 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.499 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:04.499 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:04.542 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.543 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.543 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:04.543 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.543 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.543 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.543 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.544 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.544 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2023-07-20T15:00:04.544 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2023-07-20T15:00:04.544 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:04.544 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.544 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:04.544 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:04.545 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.545 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.545 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:04.545 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.545 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.545 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.545 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.545 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.546 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2023-07-20T15:00:04.546 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2023-07-20T15:00:04.546 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:04.546 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.546 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:04.546 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:04.546 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:04.548 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.548 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:04.548 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2023-07-20T15:00:04.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:04.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:04.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:04.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:04.589 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:04.589 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:04.589 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.589 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:04.589 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:04.589 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.589 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.590 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:04.590 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:04.590 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:04.590 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:04.590 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:04.591 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:04.591 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:04.609 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:04.610 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.610 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.610 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.610 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.610 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.612 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:04.612 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.612 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.612 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.612 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.612 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.612 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:04.613 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:04.613 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:04.613 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.613 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:04.613 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:04.613 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.613 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.613 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:04.614 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:04.624 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:04.651 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.651 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.651 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.651 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.651 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.651 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:04.651 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:04.652 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:04.652 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.652 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:04.673 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:04.673 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.673 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.673 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:04.674 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.674 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.674 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.674 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.674 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:04.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:04.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:04.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2023-07-20T15:00:04.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:04.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:04.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:04.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2023-07-20T15:00:04.676 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2023-07-20T15:00:04.676 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:04.706 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:04.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2023-07-20T15:00:04.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.714 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:04.714 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.714 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.714 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.714 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.715 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.715 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2023-07-20T15:00:04.715 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2023-07-20T15:00:04.715 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:04.715 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.715 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:04.715 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2023-07-20T15:00:04.715 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.716 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.716 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:04.734 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.735 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.735 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.735 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.735 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.735 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:04.736 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:04.736 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:04.736 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.761 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:04.770 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:04.770 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:04.770 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:04.770 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:04.770 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:04.770 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.770 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.770 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.771 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.771 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.771 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:04.771 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:04.771 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:04.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:04.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:04.820 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.820 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:04.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:04.828 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:04.828 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:04.828 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.828 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:04.828 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:04.828 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:04.865 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:04.865 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:04.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:04.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:04.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:04.879 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:04.881 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:04.881 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.882 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:04.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:04.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:04.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:04.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:04.889 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.890 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.890 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:04.890 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:04.922 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.922 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:04.922 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:04.922 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:04.922 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:04.923 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:04.923 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:04.923 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2023-07-20T15:00:04.923 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:04.923 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:04.923 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:04.923 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2023-07-20T15:00:04.923 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2023-07-20T15:00:04.924 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:04.924 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:04.924 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:04.924 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:04.924 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:04.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:04.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:04.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2023-07-20T15:00:04.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:04.979 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2023-07-20T15:00:05.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2023-07-20T15:00:05.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:05.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:05.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:05.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.057 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.058 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.058 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2023-07-20T15:00:05.058 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2023-07-20T15:00:05.058 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:05.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:05.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:05.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2023-07-20T15:00:05.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2023-07-20T15:00:05.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:05.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.132 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.132 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.132 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.150 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2023-07-20T15:00:05.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2023-07-20T15:00:05.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:05.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:05.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:05.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2023-07-20T15:00:05.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2023-07-20T15:00:05.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:05.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:05.197 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:05.198 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.198 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.198 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.243 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.243 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.243 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.243 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.244 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.244 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2023-07-20T15:00:05.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2023-07-20T15:00:05.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:05.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:05.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2023-07-20T15:00:05.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.332 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.332 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.332 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.332 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.332 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.332 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.333 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2023-07-20T15:00:05.333 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2023-07-20T15:00:05.333 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:05.333 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.333 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:05.333 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:05.333 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.334 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.334 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.334 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.334 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.334 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.334 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.334 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.334 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2023-07-20T15:00:05.335 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2023-07-20T15:00:05.335 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:05.335 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.335 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:05.335 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2023-07-20T15:00:05.335 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2023-07-20T15:00:05.335 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.335 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.336 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.336 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.393 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.393 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.393 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.394 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2023-07-20T15:00:05.394 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2023-07-20T15:00:05.394 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:05.394 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.394 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:05.394 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2023-07-20T15:00:05.394 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.408 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.446 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.446 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2023-07-20T15:00:05.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2023-07-20T15:00:05.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:05.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:05.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:05.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.483 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:05.483 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:05.507 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:05.507 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.507 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:05.531 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:05.531 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.531 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.531 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:05.531 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:05.532 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:05.532 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:05.532 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:05.574 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:05.574 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:05.575 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:05.575 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.575 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.575 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.575 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.575 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.575 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:05.576 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:05.576 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:05.576 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.601 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:05.602 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:05.602 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.602 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.602 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.602 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.602 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.602 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.602 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.603 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.603 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:05.603 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:05.603 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:05.625 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.625 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:05.625 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:05.626 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.626 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.626 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:05.626 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:05.626 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:05.626 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:05.658 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:05.658 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:05.658 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:05.659 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:05.677 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.677 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.677 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.677 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.677 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:05.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:05.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:05.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:05.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:05.680 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.680 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.680 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.681 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.681 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.681 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.681 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.681 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.681 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2023-07-20T15:00:05.681 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2023-07-20T15:00:05.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:05.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:05.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:05.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.685 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2023-07-20T15:00:05.687 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2023-07-20T15:00:05.687 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:05.687 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.687 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:05.688 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:05.688 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.688 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.688 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.688 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.688 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.688 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.689 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2023-07-20T15:00:05.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2023-07-20T15:00:05.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:05.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:05.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2023-07-20T15:00:05.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.710 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.710 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:05.710 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:05.710 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.710 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:05.710 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2023-07-20T15:00:05.710 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:05.710 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:05.711 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:05.711 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:05.711 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:05.711 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:05.711 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.711 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:05.711 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:05.712 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.712 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.712 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:05.717 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:05.718 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:05.718 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:05.749 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:05.749 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:05.751 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:05.751 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:05.751 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.751 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:05.751 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:05.751 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.751 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.752 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.752 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.760 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.761 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.761 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.761 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.762 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:05.762 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:05.795 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:05.796 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.796 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:05.796 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:05.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:05.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:05.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:05.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:05.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:05.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:05.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:05.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:05.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:05.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:05.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:05.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:05.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:05.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.898 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:05.898 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:05.898 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.898 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:05.899 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2023-07-20T15:00:05.899 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:05.899 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:05.899 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:05.899 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:05.899 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:05.899 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:05.899 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.900 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:05.900 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:05.943 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.944 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.944 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:05.946 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:05.946 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:05.947 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:05.947 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:05.947 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:05.974 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:05.974 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:05.974 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:05.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:05.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:05.976 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.976 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:05.976 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:05.976 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:05.976 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:05.976 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:05.976 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:05.976 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:05.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:05.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:05.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:05.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:05.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:05.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:05.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:05.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:05.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:06.007 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:06.008 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:06.008 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:06.012 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:06.037 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:06.061 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:06.061 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:06.061 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:06.061 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:06.061 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:06.061 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:06.061 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:06.062 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:06.062 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:06.062 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:06.062 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:06.062 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:06.076 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:06.076 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:06.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:06.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:06.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:06.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:06.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:06.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:06.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:06.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:06.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:06.105 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:06.106 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:06.106 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:06.106 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:06.106 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2023-07-20T15:00:06.106 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:06.106 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:06.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:06.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2023-07-20T15:00:06.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2023-07-20T15:00:06.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:06.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:06.133 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:06.133 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2023-07-20T15:00:06.133 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:06.134 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:06.134 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:06.134 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:06.134 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:06.134 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:06.134 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:06.134 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:06.134 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2023-07-20T15:00:06.135 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2023-07-20T15:00:06.135 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:06.135 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:06.135 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:06.135 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:06.135 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:06.135 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:06.135 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:06.136 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:06.136 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:06.155 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:06.156 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:06.156 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:06.156 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2023-07-20T15:00:06.156 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2023-07-20T15:00:06.156 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:06.156 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:06.156 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:06.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2023-07-20T15:00:06.185 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:06.185 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:06.186 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:06.186 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:06.193 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:06.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:06.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:06.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:06.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:06.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:06.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:06.195 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:06.195 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:06.195 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:06.195 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:06.195 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:06.195 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:06.195 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:06.196 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:06.196 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:06.196 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:06.196 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:06.196 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:06.196 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:06.196 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:06.196 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:06.210 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:06.210 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:06.210 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:06.210 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:06.210 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:06.211 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:06.211 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:06.235 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:06.235 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:06.235 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:06.235 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:06.235 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:06.236 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:06.236 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:06.236 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:06.249 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:06.250 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:06.250 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:06.250 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:06.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:06.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:06.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:06.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:06.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:06.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:06.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:06.276 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:06.276 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:06.292 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:06.292 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:06.293 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:06.293 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:06.293 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:06.293 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:06.293 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:06.293 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:06.293 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:06.294 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:06.294 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:06.294 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:06.294 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:06.294 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:06.294 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:06.294 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:06.294 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:06.295 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:06.295 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:06.295 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:06.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:06.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:06.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:06.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:06.323 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2023-07-20T15:00:06.324 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2023-07-20T15:00:06.330 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:06.330 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:06.335 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:06.335 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:06.336 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:06.336 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:06.336 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:06.336 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:06.336 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:06.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:06.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:06.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:06.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2023-07-20T15:00:06.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2023-07-20T15:00:06.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:06.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2023-07-20T15:00:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:06.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:06.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:06.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2023-07-20T15:00:06.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2023-07-20T15:00:06.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:06.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:06.339 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2023-07-20T15:00:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:06.341 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:06.341 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:06.341 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:06.341 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:06.341 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:06.341 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2023-07-20T15:00:06.341 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2023-07-20T15:00:06.364 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2023-07-20T15:00:06.365 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2023-07-20T15:00:06.368 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2023-07-20T15:00:06.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2023-07-20T15:00:06.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2023-07-20T15:00:06.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2023-07-20T15:00:06.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2023-07-20T15:00:06.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2023-07-20T15:00:06.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2023-07-20T15:00:06.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:06.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2023-07-20T15:00:06.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2023-07-20T15:00:06.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2023-07-20T15:00:06.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2023-07-20T15:00:06.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2023-07-20T15:00:06.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2023-07-20T15:00:06.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2023-07-20T15:00:06.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2023-07-20T15:00:06.371 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2023-07-20T15:00:06.371 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2023-07-20T15:00:06.371 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2023-07-20T15:00:06.395 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2023-07-20T15:00:06.395 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:06.396 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 0, 2023-07-20T15:00:06.397 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2023-07-20T15:00:06.397 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:06.397 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2023-07-20T15:00:06.397 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:06.397 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2023-07-20T15:00:06.397 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.29:0", 2023-07-20T15:00:06.397 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 3782113586 2023-07-20T15:00:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2023-07-20T15:00:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2023-07-20T15:00:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2023-07-20T15:00:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.29:0", 2023-07-20T15:00:06.399 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 3979765469 2023-07-20T15:00:06.399 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:06.399 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2023-07-20T15:00:06.399 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:06.399 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:06.399 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2023-07-20T15:00:06.399 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:06.400 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2023-07-20T15:00:06.400 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.29:0", 2023-07-20T15:00:06.400 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 784956587 2023-07-20T15:00:06.401 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:06.401 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2023-07-20T15:00:06.401 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:06.428 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2023-07-20T15:00:06.428 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:06.429 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:06.429 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:55 smithi029 bash[104935]: audit 2023-07-20T14:59:54.132183+0000 mon.a (mon.0) 35 : audit [INF] from='client.? 172.21.15.29:0/1542583085' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-07-20T15:00:06.429 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:55 smithi029 bash[104935]: cluster 2023-07-20T14:59:54.132231+0000 mon.a (mon.0) 36 : cluster [DBG] mgrmap e5: y(active, since 4s) 2023-07-20T15:00:06.430 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:55 smithi029 bash[104935]: audit 2023-07-20T14:59:55.039250+0000 mon.a (mon.0) 37 : audit [DBG] from='client.? 172.21.15.29:0/2665367979' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2023-07-20T15:00:06.431 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Waiting for the mgr to restart... 2023-07-20T15:00:06.431 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Waiting for Mgr epoch 5... 2023-07-20T15:00:06.431 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2023-07-20T15:00:06.431 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2023-07-20T15:00:06.431 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:06.431 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 7, 2023-07-20T15:00:06.431 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2023-07-20T15:00:06.432 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:06.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:59 smithi029 bash[104935]: cluster 2023-07-20T14:59:58.056196+0000 mon.a (mon.0) 38 : cluster [INF] Active manager daemon y restarted 2023-07-20T15:00:06.466 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:59 smithi029 bash[104935]: cluster 2023-07-20T14:59:58.056725+0000 mon.a (mon.0) 39 : cluster [INF] Activating manager daemon y 2023-07-20T15:00:06.466 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:59 smithi029 bash[104935]: cluster 2023-07-20T14:59:58.058268+0000 mon.a (mon.0) 40 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2023-07-20T15:00:06.467 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:59 smithi029 bash[104935]: cluster 2023-07-20T14:59:58.108973+0000 mon.a (mon.0) 41 : cluster [DBG] mgrmap e6: y(active, starting, since 0.052348s) 2023-07-20T15:00:06.467 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:59 smithi029 bash[104935]: audit 2023-07-20T14:59:58.110617+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-20T15:00:06.467 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:59 smithi029 bash[104935]: audit 2023-07-20T14:59:58.111187+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-20T15:00:06.467 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:59 smithi029 bash[104935]: audit 2023-07-20T14:59:58.111332+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-20T15:00:06.467 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:59 smithi029 bash[104935]: audit 2023-07-20T14:59:58.111465+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-20T15:00:06.467 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:59 smithi029 bash[104935]: audit 2023-07-20T14:59:58.111729+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2023-07-20T15:00:06.467 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:59 smithi029 bash[104935]: audit 2023-07-20T14:59:58.112218+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2023-07-20T15:00:06.468 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:59 smithi029 bash[104935]: audit 2023-07-20T14:59:58.112447+0000 mon.a (mon.0) 48 : audit [DBG] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2023-07-20T15:00:06.468 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:59 smithi029 bash[104935]: cluster 2023-07-20T14:59:58.125458+0000 mon.a (mon.0) 49 : cluster [INF] Manager daemon y is now available 2023-07-20T15:00:06.470 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:59 smithi029 bash[104935]: audit 2023-07-20T14:59:58.144368+0000 mon.a (mon.0) 50 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-20T15:00:06.470 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 14:59:59 smithi029 bash[104935]: audit 2023-07-20T14:59:59.029707+0000 mon.a (mon.0) 51 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-20T15:00:06.471 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Setting orchestrator backend to cephadm... 2023-07-20T15:00:06.471 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'set', 'backend', 'cephadm'] 2023-07-20T15:00:06.471 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch set backend cephadm 2023-07-20T15:00:06.472 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[104935]: cluster 2023-07-20T14:59:59.111294+0000 mon.a (mon.0) 52 : cluster [DBG] mgrmap e7: y(active, since 1.05466s) 2023-07-20T15:00:06.472 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[104935]: audit 2023-07-20T15:00:00.005634+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd=[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]: dispatch 2023-07-20T15:00:06.497 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[104935]: audit 2023-07-20T15:00:00.008144+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd='[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]': finished 2023-07-20T15:00:06.498 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Generating ssh key... 2023-07-20T15:00:06.498 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'generate-key'] 2023-07-20T15:00:06.498 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm generate-key 2023-07-20T15:00:06.498 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:01 smithi029 bash[104935]: audit 2023-07-20T15:00:00.004315+0000 mgr.y (mgr.14119) 1 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:00:06.499 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:01 smithi029 bash[104935]: audit 2023-07-20T15:00:00.910091+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEAvTzrCLNEDhEmolrngzzqPrder6LLsteinXb9GwWzy17uhjb6+vOw\nB21qRW5XRegWVFees456G9DaFjownDuLikCDLDIe4tPwen8mQ4IorC/cEUTnk5GBEL64kV\nlE0P6rQv7XOGq1lJKcrjutk5AS00hYEZvre9BODJMZeuKWdxJZzILjdYFFfVqVUSv3tVwA\ngFKDQ9Y5T5wtvf2WWbKJK7BcFxenAjkPA2m8kP6GxBdV2hpt89LghyhwYkNnPHcLzpF9cq\nrk61a7KWJwxpv4TZntq8QpI/6JqkU3sQNP4SGO99d2qj6Zl9MDbxHH/YOjYlZRMLEpEBEu\nI75YLe7it3aaAEihVoCZn1dPUbbIgTcdslg+6EZ1hT7LjghU92hm205Zeys/hUIz3eUy6D\n6Tl3GFWC1wsy7i+8Tpy3j86/0FE6/DNVMEkCei9p6xsH2VEzYZ+ij3PpBlpQXDW8ynTfx+\nq7vMt4xDfLE17tCJa1scOzotVU/0Le3W9RrhWDfnAAAFoDe+bH03vmx9AAAAB3NzaC1yc2\nEAAAGBAL086wizRA4RJqJa54M86j63Xq+iy7LXop12/RsFs8te7oY2+vrzsAdtakVuV0Xo\nFlRXnrOOehvQ2hY6MJw7i4pAgywyHuLT8Hp/JkOCKKwv3BFE55ORgRC+uJFZRND+q0L+1z\nhqtZSSnK47rZOQEtNIWBGb63vQTgyTGXrilncSWcyC43WBRX1alVEr97VcAIBSg0PWOU+c\nLb39llmyiSuwXBcXpwI5DwNpvJD+hsQXVdoabfPS4IcocGJDZzx3C86RfXKq5OtWuylicM\nab+E2Z7avEKSP+iapFN7EDT+EhjvfXdqo+mZfTA28Rx/2Do2JWUTCxKRARLiO+WC3u4rd2\nmgBIoVaAmZ9XT1G2yIE3HbJYPuhGdYU+y44IVPdoZttOWXsrP4VCM93lMug+k5dxhVgtcL\nMu4vvE6ct4/Ov9BROvwzVTBJAnovaesbB9lRM2Gfoo9z6QZaUFw1vMp038fqu7zLeMQ3yx\nNe7QiWtbHDs6LVVP9C3t1vUa4Vg35wAAAAMBAAEAAAGACAV/CP1gUyBS/OrRiXSZkVMAhn\n1mGQye7gHPNMgHGQXLIpFODjkqKwZuTMcil+oAmE6mgYH2lxtBQ1PwH48+mPunE8aEHKVT\nOj4NhysLQlE9CNZc4pp2WBldhXu9OQayh8J5qQCM9eFJFvGcp/ahdadJZGWxk6v+wvWxTM\n4yBpYWjF63+ZEjOu8OCUTN2TgvJUFaIxP/lepO3hDTwLWarulo3em4wJVel4xx28uONt2u\nW/Jm2sEDl3cVXHTy+VMqcDhVRaSKeS8w3aXcma5Kd/msLspLto2im3O8hIC/3MNulvFlwm\nnrCntW9smSKHYM+ZZ9a52F7uufLrw2s3TlBwnGfpShtouiSc4/iHCHz0UnFEyYE8Ygo1OX\nxYDZHjxKmiOBKpnyFGkO8V8z7lmA3LoZjA06oujyH0X0aptZiwvV3b9X7rt8Ug5mJU+yQ6\nXiqKrTZDXIb0xRu+D8nRgqz9EBcs/3Kqf9I0PCyJc6l8rvqIqET1mH2eQ2K3rw8A8xAAAA\nwGvsv87NDZF5GBGb2C+nC15yaWQ0GXA/MBbkb7WXk4qMm8InYj5WxANxPbgjulpVcmHi9Q\nArrxyyaMgnwUfJTWFbqHS+uJxoTsUHOKp52OVinzo/tzl6zo4U5yF6kY8QEZHCp+8+CYjH\nYEMr9NCP3AtquWQfGcz+0cK2xdZzPAdgjIsN3uoo/9v1IYYX200d5nxwIc8BruWLYm55Of\nJtQSR5ulzgeyqTlddRms+cl7osK5LYruAOmqJyFgXTvGWBVAAAAMEA8SOFw4B2mSdE0K30\nobq7XgZhEvzEtVkSm5+KCA6HwUml+T0KFJ7OEVxJhyu7wNT4XTIu1jZGzAeXE6K0Pb1jZH\nV4DCRF7Amlhp/tF0bLe2lUhMcAiOFm3qVAFxwYhxGMteNtrp94dZ9kbtM+BRcJkEYiSbP0\niNBuYTdDuI5dOB/9R6Va69jArV4wGOi06j0VGfvyFly0zNRsLLvssLPYT9BpI0flEsz2tE\nHpWUli8E09smZv6kENpndhj7CNlxwdAAAAwQDI5ozKF2/SH8quVwTw0tkzwZxnhnhxeJJr\nIwI76j4f6I6mgambXgxdJPIbdG27R+CvrD4sgEUyYpmcPFB6daVMHHPvzJnJcSnH8PKpA8\nc5UhW3FtSMKX0ZlcHq+l7N1iE/lET+NLkFZPF9neiUghsOFZ0ZRuwGpvoFQkvlmVTWke8j\neWN8889DS+sPTbWxaWMrxjjvTQeNIFNkgFj29W477mjbE1Sx6Sf9nb1YtL+6f6LeJPCq16\n6858z4NEmGfNMAAAApY2VwaC0wMjFjOTg2MC0yNzBlLTExZWUtOWIzNC0wMDFhNGFhYjgz\nMGMBAg==\n-----END OPENSSH PRIVATE KEY-----\n"}]: dispatch 2023-07-20T15:00:06.499 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:01 smithi029 bash[104935]: audit 2023-07-20T15:00:00.911823+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEAvTzrCLNEDhEmolrngzzqPrder6LLsteinXb9GwWzy17uhjb6+vOw\nB21qRW5XRegWVFees456G9DaFjownDuLikCDLDIe4tPwen8mQ4IorC/cEUTnk5GBEL64kV\nlE0P6rQv7XOGq1lJKcrjutk5AS00hYEZvre9BODJMZeuKWdxJZzILjdYFFfVqVUSv3tVwA\ngFKDQ9Y5T5wtvf2WWbKJK7BcFxenAjkPA2m8kP6GxBdV2hpt89LghyhwYkNnPHcLzpF9cq\nrk61a7KWJwxpv4TZntq8QpI/6JqkU3sQNP4SGO99d2qj6Zl9MDbxHH/YOjYlZRMLEpEBEu\nI75YLe7it3aaAEihVoCZn1dPUbbIgTcdslg+6EZ1hT7LjghU92hm205Zeys/hUIz3eUy6D\n6Tl3GFWC1wsy7i+8Tpy3j86/0FE6/DNVMEkCei9p6xsH2VEzYZ+ij3PpBlpQXDW8ynTfx+\nq7vMt4xDfLE17tCJa1scOzotVU/0Le3W9RrhWDfnAAAFoDe+bH03vmx9AAAAB3NzaC1yc2\nEAAAGBAL086wizRA4RJqJa54M86j63Xq+iy7LXop12/RsFs8te7oY2+vrzsAdtakVuV0Xo\nFlRXnrOOehvQ2hY6MJw7i4pAgywyHuLT8Hp/JkOCKKwv3BFE55ORgRC+uJFZRND+q0L+1z\nhqtZSSnK47rZOQEtNIWBGb63vQTgyTGXrilncSWcyC43WBRX1alVEr97VcAIBSg0PWOU+c\nLb39llmyiSuwXBcXpwI5DwNpvJD+hsQXVdoabfPS4IcocGJDZzx3C86RfXKq5OtWuylicM\nab+E2Z7avEKSP+iapFN7EDT+EhjvfXdqo+mZfTA28Rx/2Do2JWUTCxKRARLiO+WC3u4rd2\nmgBIoVaAmZ9XT1G2yIE3HbJYPuhGdYU+y44IVPdoZttOWXsrP4VCM93lMug+k5dxhVgtcL\nMu4vvE6ct4/Ov9BROvwzVTBJAnovaesbB9lRM2Gfoo9z6QZaUFw1vMp038fqu7zLeMQ3yx\nNe7QiWtbHDs6LVVP9C3t1vUa4Vg35wAAAAMBAAEAAAGACAV/CP1gUyBS/OrRiXSZkVMAhn\n1mGQye7gHPNMgHGQXLIpFODjkqKwZuTMcil+oAmE6mgYH2lxtBQ1PwH48+mPunE8aEHKVT\nOj4NhysLQlE9CNZc4pp2WBldhXu9OQayh8J5qQCM9eFJFvGcp/ahdadJZGWxk6v+wvWxTM\n4yBpYWjF63+ZEjOu8OCUTN2TgvJUFaIxP/lepO3hDTwLWarulo3em4wJVel4xx28uONt2u\nW/Jm2sEDl3cVXHTy+VMqcDhVRaSKeS8w3aXcma5Kd/msLspLto2im3O8hIC/3MNulvFlwm\nnrCntW9smSKHYM+ZZ9a52F7uufLrw2s3TlBwnGfpShtouiSc4/iHCHz0UnFEyYE8Ygo1OX\nxYDZHjxKmiOBKpnyFGkO8V8z7lmA3LoZjA06oujyH0X0aptZiwvV3b9X7rt8Ug5mJU+yQ6\nXiqKrTZDXIb0xRu+D8nRgqz9EBcs/3Kqf9I0PCyJc6l8rvqIqET1mH2eQ2K3rw8A8xAAAA\nwGvsv87NDZF5GBGb2C+nC15yaWQ0GXA/MBbkb7WXk4qMm8InYj5WxANxPbgjulpVcmHi9Q\nArrxyyaMgnwUfJTWFbqHS+uJxoTsUHOKp52OVinzo/tzl6zo4U5yF6kY8QEZHCp+8+CYjH\nYEMr9NCP3AtquWQfGcz+0cK2xdZzPAdgjIsN3uoo/9v1IYYX200d5nxwIc8BruWLYm55Of\nJtQSR5ulzgeyqTlddRms+cl7osK5LYruAOmqJyFgXTvGWBVAAAAMEA8SOFw4B2mSdE0K30\nobq7XgZhEvzEtVkSm5+KCA6HwUml+T0KFJ7OEVxJhyu7wNT4XTIu1jZGzAeXE6K0Pb1jZH\nV4DCRF7Amlhp/tF0bLe2lUhMcAiOFm3qVAFxwYhxGMteNtrp94dZ9kbtM+BRcJkEYiSbP0\niNBuYTdDuI5dOB/9R6Va69jArV4wGOi06j0VGfvyFly0zNRsLLvssLPYT9BpI0flEsz2tE\nHpWUli8E09smZv6kENpndhj7CNlxwdAAAAwQDI5ozKF2/SH8quVwTw0tkzwZxnhnhxeJJr\nIwI76j4f6I6mgambXgxdJPIbdG27R+CvrD4sgEUyYpmcPFB6daVMHHPvzJnJcSnH8PKpA8\nc5UhW3FtSMKX0ZlcHq+l7N1iE/lET+NLkFZPF9neiUghsOFZ0ZRuwGpvoFQkvlmVTWke8j\neWN8889DS+sPTbWxaWMrxjjvTQeNIFNkgFj29W477mjbE1Sx6Sf9nb1YtL+6f6LeJPCq16\n6858z4NEmGfNMAAAApY2VwaC0wMjFjOTg2MC0yNzBlLTExZWUtOWIzNC0wMDFhNGFhYjgz\nMGMBAg==\n-----END OPENSSH PRIVATE KEY-----\n"}]': finished 2023-07-20T15:00:06.499 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:01 smithi029 bash[104935]: audit 2023-07-20T15:00:00.912195+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9POsIs0QOESaiWueDPOo+t16vosuy16Kddv0bBbPLXu6GNvr687AHbWpFbldF6BZUV56zjnob0NoWOjCcO4uKQIMsMh7i0/B6fyZDgiisL9wRROeTkYEQvriRWUTQ/qtC/tc4arWUkpyuO62TkBLTSFgRm+t70E4Mkxl64pZ3ElnMguN1gUV9WpVRK/e1XACAUoND1jlPnC29/ZZZsokrsFwXF6cCOQ8DabyQ/obEF1XaGm3z0uCHKHBiQ2c8dwvOkX1yquTrVrspYnDGm/hNme2rxCkj/omqRTexA0/hIY7313aqPpmX0wNvEcf9g6NiVlEwsSkQES4jvlgt7uK3dpoASKFWgJmfV09RtsiBNx2yWD7oRnWFPsuOCFT3aGbbTll7Kz+FQjPd5TLoPpOXcYVYLXCzLuL7xOnLePzr/QUTr8M1UwSQJ6L2nrGwfZUTNhn6KPc+kGWlBcNbzKdN/H6ru8y3jEN8sTXu0IlrWxw7Oi1VT/Qt7db1GuFYN+c= ceph-021c9860-270e-11ee-9b34-001a4aab830c\n"}]: dispatch 2023-07-20T15:00:06.499 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:01 smithi029 bash[104935]: audit 2023-07-20T15:00:00.913377+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9POsIs0QOESaiWueDPOo+t16vosuy16Kddv0bBbPLXu6GNvr687AHbWpFbldF6BZUV56zjnob0NoWOjCcO4uKQIMsMh7i0/B6fyZDgiisL9wRROeTkYEQvriRWUTQ/qtC/tc4arWUkpyuO62TkBLTSFgRm+t70E4Mkxl64pZ3ElnMguN1gUV9WpVRK/e1XACAUoND1jlPnC29/ZZZsokrsFwXF6cCOQ8DabyQ/obEF1XaGm3z0uCHKHBiQ2c8dwvOkX1yquTrVrspYnDGm/hNme2rxCkj/omqRTexA0/hIY7313aqPpmX0wNvEcf9g6NiVlEwsSkQES4jvlgt7uK3dpoASKFWgJmfV09RtsiBNx2yWD7oRnWFPsuOCFT3aGbbTll7Kz+FQjPd5TLoPpOXcYVYLXCzLuL7xOnLePzr/QUTr8M1UwSQJ6L2nrGwfZUTNhn6KPc+kGWlBcNbzKdN/H6ru8y3jEN8sTXu0IlrWxw7Oi1VT/Qt7db1GuFYN+c= ceph-021c9860-270e-11ee-9b34-001a4aab830c\n"}]': finished 2023-07-20T15:00:06.499 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:01 smithi029 bash[104935]: cluster 2023-07-20T15:00:01.009160+0000 mon.a (mon.0) 59 : cluster [DBG] mgrmap e8: y(active, since 2s) 2023-07-20T15:00:06.500 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[105170]: Generating public/private rsa key pair. 2023-07-20T15:00:06.538 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[105170]: Your identification has been saved in /tmp/tmp29anazqg/key. 2023-07-20T15:00:06.539 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[105170]: Your public key has been saved in /tmp/tmp29anazqg/key.pub. 2023-07-20T15:00:06.539 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[105170]: The key fingerprint is: 2023-07-20T15:00:06.539 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[105170]: SHA256:WpVsc38M2wWiKoBZIY49LsLZFEbrGz8qohlQusvZIN0 ceph-021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T15:00:06.539 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[105170]: The key's randomart image is: 2023-07-20T15:00:06.541 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[105170]: +---[RSA 3072]----+ 2023-07-20T15:00:06.541 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[105170]: | o+o. . . | 2023-07-20T15:00:06.541 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[105170]: | +.=o . o . . | 2023-07-20T15:00:06.541 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[105170]: |. Bo. B . . .| 2023-07-20T15:00:06.541 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[105170]: |.+=. . + o . =.| 2023-07-20T15:00:06.541 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[105170]: |=o.+ . S o +| 2023-07-20T15:00:06.542 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[105170]: |o+ .+ + . | 2023-07-20T15:00:06.542 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[105170]: |+...Eo. | 2023-07-20T15:00:06.542 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[105170]: |+=+ . . | 2023-07-20T15:00:06.542 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[105170]: |*o.o | 2023-07-20T15:00:06.543 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:00 smithi029 bash[105170]: +----[SHA256]-----+ 2023-07-20T15:00:06.555 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'get-pub-key'] 2023-07-20T15:00:06.556 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm get-pub-key 2023-07-20T15:00:06.577 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9POsIs0QOESaiWueDPOo+t16vosuy16Kddv0bBbPLXu6GNvr687AHbWpFbldF6BZUV56zjnob0NoWOjCcO4uKQIMsMh7i0/B6fyZDgiisL9wRROeTkYEQvriRWUTQ/qtC/tc4arWUkpyuO62TkBLTSFgRm+t70E4Mkxl64pZ3ElnMguN1gUV9WpVRK/e1XACAUoND1jlPnC29/ZZZsokrsFwXF6cCOQ8DabyQ/obEF1XaGm3z0uCHKHBiQ2c8dwvOkX1yquTrVrspYnDGm/hNme2rxCkj/omqRTexA0/hIY7313aqPpmX0wNvEcf9g6NiVlEwsSkQES4jvlgt7uK3dpoASKFWgJmfV09RtsiBNx2yWD7oRnWFPsuOCFT3aGbbTll7Kz+FQjPd5TLoPpOXcYVYLXCzLuL7xOnLePzr/QUTr8M1UwSQJ6L2nrGwfZUTNhn6KPc+kGWlBcNbzKdN/H6ru8y3jEN8sTXu0IlrWxw7Oi1VT/Qt7db1GuFYN+c= ceph-021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T15:00:06.578 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:02 smithi029 bash[104935]: audit 2023-07-20T15:00:00.829158+0000 mgr.y (mgr.14119) 2 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:00:06.578 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:02 smithi029 bash[104935]: cephadm 2023-07-20T15:00:00.829388+0000 mgr.y (mgr.14119) 3 : cephadm [INF] Generating ssh key... 2023-07-20T15:00:06.579 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2023-07-20T15:00:06.580 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Adding key to root@localhost's authorized_keys... 2023-07-20T15:00:06.580 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Adding host smithi029... 2023-07-20T15:00:06.580 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'host', 'add', 'smithi029'] 2023-07-20T15:00:06.580 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch host add smithi029 2023-07-20T15:00:06.580 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:03 smithi029 bash[104935]: audit 2023-07-20T15:00:01.766955+0000 mgr.y (mgr.14119) 4 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:00:06.581 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:04 smithi029 bash[105170]: Warning: Permanently added 'smithi029,172.21.15.29' (ECDSA) to the list of known hosts. 2023-07-20T15:00:06.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Added host 'smithi029' 2023-07-20T15:00:06.581 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:05 smithi029 bash[104935]: audit 2023-07-20T15:00:04.802466+0000 mgr.y (mgr.14119) 5 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi029", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:00:06.582 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:05 smithi029 bash[104935]: audit 2023-07-20T15:00:05.408774+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"smithi029\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2023-07-20T15:00:06.582 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:05 smithi029 bash[104935]: audit 2023-07-20T15:00:05.410437+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"smithi029\", \"labels\": [], \"status\": \"\"}}"}]': finished 2023-07-20T15:00:06.582 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:05 smithi029 bash[104935]: audit 2023-07-20T15:00:05.643397+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:00:06.582 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:05 smithi029 bash[104935]: audit 2023-07-20T15:00:05.645027+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:00:06.582 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:05 smithi029 bash[104935]: audit 2023-07-20T15:00:05.645497+0000 mon.a (mon.0) 64 : audit [DBG] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:00:07.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:06 smithi029 bash[104935]: cephadm 2023-07-20T15:00:05.410930+0000 mgr.y (mgr.14119) 6 : cephadm [INF] Added host smithi029 2023-07-20T15:00:09.281 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Enabling the dashboard module... 2023-07-20T15:00:09.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'dashboard'] 2023-07-20T15:00:09.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable dashboard 2023-07-20T15:00:11.195 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:10 smithi029 bash[104935]: audit 2023-07-20T15:00:10.525429+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:10.522256\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:10.524750\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2023-07-20T15:00:10.524895\", \"networks\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:00:11.195 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:10 smithi029 bash[104935]: audit 2023-07-20T15:00:10.527458+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:10.522256\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:10.524750\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2023-07-20T15:00:10.524895\", \"networks\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:00:11.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:10 smithi029 bash[104935]: audit 2023-07-20T15:00:10.527980+0000 mon.a (mon.0) 67 : audit [DBG] from='mgr.14119 172.21.15.29:0/515240171' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:00:12.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:11 smithi029 bash[104935]: audit 2023-07-20T15:00:11.522262+0000 mon.a (mon.0) 68 : audit [INF] from='client.? 172.21.15.29:0/2763248139' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-07-20T15:00:12.199 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:11 smithi029 bash[105170]: ignoring --setuser ceph since I am not root 2023-07-20T15:00:12.199 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:11 smithi029 bash[105170]: ignoring --setgroup ceph since I am not root 2023-07-20T15:00:12.977 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:12 smithi029 bash[104935]: audit 2023-07-20T15:00:11.780134+0000 mon.a (mon.0) 69 : audit [INF] from='client.? 172.21.15.29:0/2763248139' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-07-20T15:00:12.977 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:12 smithi029 bash[104935]: cluster 2023-07-20T15:00:11.780187+0000 mon.a (mon.0) 70 : cluster [DBG] mgrmap e9: y(active, since 13s) 2023-07-20T15:00:15.346 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2023-07-20T15:00:15.346 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2023-07-20T15:00:15.953 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:15 smithi029 bash[105170]: Warning: Permanently added 'smithi029,172.21.15.29' (ECDSA) to the list of known hosts. 2023-07-20T15:00:17.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:16 smithi029 bash[104935]: cluster 2023-07-20T15:00:15.623023+0000 mon.a (mon.0) 71 : cluster [INF] Active manager daemon y restarted 2023-07-20T15:00:17.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:16 smithi029 bash[104935]: cluster 2023-07-20T15:00:15.623445+0000 mon.a (mon.0) 72 : cluster [INF] Activating manager daemon y 2023-07-20T15:00:17.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:16 smithi029 bash[104935]: cluster 2023-07-20T15:00:15.624977+0000 mon.a (mon.0) 73 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2023-07-20T15:00:17.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:16 smithi029 bash[104935]: cluster 2023-07-20T15:00:15.777816+0000 mon.a (mon.0) 74 : cluster [DBG] mgrmap e10: y(active, starting, since 0.15444s) 2023-07-20T15:00:17.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:16 smithi029 bash[104935]: audit 2023-07-20T15:00:15.779309+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-20T15:00:17.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:16 smithi029 bash[104935]: audit 2023-07-20T15:00:15.779981+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-20T15:00:17.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:16 smithi029 bash[104935]: audit 2023-07-20T15:00:15.780165+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-20T15:00:17.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:16 smithi029 bash[104935]: audit 2023-07-20T15:00:15.780348+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-20T15:00:17.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:16 smithi029 bash[104935]: audit 2023-07-20T15:00:15.780634+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2023-07-20T15:00:17.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:16 smithi029 bash[104935]: audit 2023-07-20T15:00:15.781211+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi029"}]: dispatch 2023-07-20T15:00:17.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:16 smithi029 bash[104935]: audit 2023-07-20T15:00:15.781465+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2023-07-20T15:00:17.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:16 smithi029 bash[104935]: audit 2023-07-20T15:00:15.781701+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2023-07-20T15:00:17.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:16 smithi029 bash[104935]: audit 2023-07-20T15:00:15.781934+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2023-07-20T15:00:17.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:16 smithi029 bash[104935]: audit 2023-07-20T15:00:15.782166+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2023-07-20T15:00:17.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:16 smithi029 bash[104935]: audit 2023-07-20T15:00:15.782400+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2023-07-20T15:00:17.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:16 smithi029 bash[104935]: cluster 2023-07-20T15:00:15.795925+0000 mon.a (mon.0) 86 : cluster [INF] Manager daemon y is now available 2023-07-20T15:00:17.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:16 smithi029 bash[104935]: audit 2023-07-20T15:00:15.819823+0000 mon.a (mon.0) 87 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-20T15:00:17.836 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:17 smithi029 bash[104935]: audit 2023-07-20T15:00:16.712687+0000 mon.a (mon.0) 88 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-20T15:00:17.836 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:17 smithi029 bash[104935]: audit 2023-07-20T15:00:16.713415+0000 mon.a (mon.0) 89 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:00:17.836 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:17 smithi029 bash[104935]: cluster 2023-07-20T15:00:16.779508+0000 mon.a (mon.0) 90 : cluster [DBG] mgrmap e11: y(active, since 1.15613s) 2023-07-20T15:00:23.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:23.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 12, 2023-07-20T15:00:23.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14142, 2023-07-20T15:00:23.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2023-07-20T15:00:23.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2023-07-20T15:00:23.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2023-07-20T15:00:23.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:23.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2023-07-20T15:00:23.207 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.29:6800", 2023-07-20T15:00:23.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 4040478195 2023-07-20T15:00:23.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:23.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:23.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2023-07-20T15:00:23.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.29:6801", 2023-07-20T15:00:23.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 4040478195 2023-07-20T15:00:23.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:23.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2023-07-20T15:00:23.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:23.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.15.29:6801/4040478195", 2023-07-20T15:00:23.280 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2023-07-20T15:00:15.623363+0000", 2023-07-20T15:00:23.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2023-07-20T15:00:23.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2023-07-20T15:00:23.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2023-07-20T15:00:23.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2023-07-20T15:00:23.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2023-07-20T15:00:23.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "dashboard", 2023-07-20T15:00:23.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2023-07-20T15:00:23.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2023-07-20T15:00:23.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:23.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2023-07-20T15:00:23.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:23.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2023-07-20T15:00:23.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:23.334 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:23.384 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:23.385 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2023-07-20T15:00:23.385 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2023-07-20T15:00:23.392 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:23.393 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:23.393 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:23.393 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2023-07-20T15:00:23.393 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:23.393 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:23.393 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:23.393 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2023-07-20T15:00:23.394 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:23.394 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:23.394 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:23.444 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:23.446 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:23.449 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:23.449 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:23.450 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:23.451 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:23.451 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:23.454 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:23.454 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:23.454 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:23.454 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:23.454 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:23.454 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:23.455 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:23.496 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:23.497 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:23.497 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:23.515 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:23.515 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:23.516 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:23.516 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:23.516 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:23.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:23.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:23.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:23.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:23.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:23.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:23.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:23.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:23.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:23.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:23.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:23.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:23.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:23.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:23.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:23.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:23.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:23.575 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:23.575 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:23.584 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:23.584 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:23.587 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:23.587 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:23.587 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:23.587 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:23.587 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:23.587 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:23.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:23.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:23.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:23.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:23.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:23.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:23.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:23.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:23.589 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:23.630 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:23.631 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:23.631 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:23.631 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:23.631 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:23.631 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:23.634 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2023-07-20T15:00:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2023-07-20T15:00:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:23.636 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:23.636 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:23.636 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:23.636 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:23.649 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:23.674 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:23.674 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2023-07-20T15:00:23.735 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:23.735 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:23.735 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:23.736 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:23.736 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2023-07-20T15:00:23.736 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2023-07-20T15:00:23.736 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:23.736 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:23.737 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:23.737 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2023-07-20T15:00:23.737 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:23.737 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:23.737 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:23.737 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2023-07-20T15:00:23.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:23.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:23.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:23.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:23.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2023-07-20T15:00:23.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2023-07-20T15:00:23.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:23.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:23.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:23.781 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:23.781 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:23.781 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:23.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:23.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2023-07-20T15:00:23.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:23.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:23.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:23.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:23.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2023-07-20T15:00:23.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2023-07-20T15:00:23.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:23.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:23.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:23.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:23.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:23.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:23.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:23.784 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2023-07-20T15:00:23.784 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:23.831 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:23.832 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:23.832 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:23.832 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2023-07-20T15:00:23.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2023-07-20T15:00:23.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:23.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:23.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:23.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2023-07-20T15:00:23.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:23.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:23.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:23.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2023-07-20T15:00:23.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:23.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:23.865 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:23.865 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:23.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2023-07-20T15:00:23.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2023-07-20T15:00:23.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:23.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:23.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:23.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:23.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:23.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:23.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:23.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2023-07-20T15:00:23.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:23.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:23.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:23.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:23.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2023-07-20T15:00:23.868 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2023-07-20T15:00:23.868 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:23.923 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:23.924 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:23.948 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:23.948 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:23.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:23.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:23.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2023-07-20T15:00:23.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:23.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:23.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:23.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:23.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2023-07-20T15:00:23.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2023-07-20T15:00:23.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:23.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:23.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:23.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:23.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:23.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:23.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:23.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2023-07-20T15:00:23.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:23.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:23.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:23.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:23.952 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:23.962 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2023-07-20T15:00:23.966 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:23.966 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:23.966 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:23.967 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2023-07-20T15:00:23.967 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2023-07-20T15:00:23.967 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:23.968 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:23.968 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:23.968 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:23.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:23.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:23.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:23.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2023-07-20T15:00:23.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:23.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:23.986 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:23.986 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:23.987 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2023-07-20T15:00:23.987 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2023-07-20T15:00:23.987 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:23.987 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.033 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.033 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2023-07-20T15:00:24.033 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.033 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.033 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.034 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2023-07-20T15:00:24.034 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2023-07-20T15:00:24.048 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.048 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.048 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.048 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2023-07-20T15:00:24.049 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2023-07-20T15:00:24.049 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2023-07-20T15:00:24.049 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.049 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.049 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2023-07-20T15:00:24.049 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2023-07-20T15:00:24.049 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2023-07-20T15:00:24.049 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.050 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2023-07-20T15:00:24.050 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-07-20T15:00:24.050 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.050 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.050 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.050 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2023-07-20T15:00:24.050 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2023-07-20T15:00:24.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2023-07-20T15:00:24.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2023-07-20T15:00:24.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2023-07-20T15:00:24.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2023-07-20T15:00:24.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2023-07-20T15:00:24.052 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.052 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.052 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.102 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.115 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2023-07-20T15:00:24.115 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2023-07-20T15:00:24.115 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:24.140 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.141 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.141 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2023-07-20T15:00:24.141 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.161 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.161 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.161 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2023-07-20T15:00:24.162 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-07-20T15:00:24.162 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.162 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.162 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.162 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2023-07-20T15:00:24.191 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2023-07-20T15:00:24.191 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2023-07-20T15:00:24.217 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2023-07-20T15:00:24.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2023-07-20T15:00:24.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2023-07-20T15:00:24.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2023-07-20T15:00:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-07-20T15:00:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2023-07-20T15:00:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2023-07-20T15:00:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.220 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.220 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2023-07-20T15:00:24.220 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.300 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2023-07-20T15:00:24.300 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2023-07-20T15:00:24.300 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.300 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.300 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.300 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2023-07-20T15:00:24.301 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2023-07-20T15:00:24.301 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2023-07-20T15:00:24.301 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.301 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.301 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2023-07-20T15:00:24.301 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2023-07-20T15:00:24.301 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2023-07-20T15:00:24.302 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-07-20T15:00:24.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-07-20T15:00:24.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.336 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:24.336 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:24.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:24.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:24.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.353 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.353 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:24.353 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:24.353 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:24.353 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:24.354 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:24.354 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:24.354 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:24.364 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:24.365 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:24.365 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.365 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.365 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:24.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:24.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:24.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.372 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:24.373 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.373 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.373 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.373 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:24.373 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.373 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.373 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:24.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:24.395 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:24.395 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.396 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.396 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:24.396 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.404 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.409 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:24.409 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:24.410 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:24.428 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:24.429 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:24.429 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:24.429 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:24.429 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:24.429 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:24.429 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.429 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.430 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.430 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.430 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:24.430 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:24.430 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:24.430 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.430 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.431 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:24.467 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.468 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.468 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.468 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:24.468 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.468 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.468 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.468 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.469 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2023-07-20T15:00:24.469 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2023-07-20T15:00:24.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2023-07-20T15:00:24.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.501 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.501 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2023-07-20T15:00:24.502 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.502 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.502 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.502 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2023-07-20T15:00:24.502 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.502 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.502 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.502 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.503 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2023-07-20T15:00:24.503 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2023-07-20T15:00:24.503 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:24.503 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.503 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.503 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2023-07-20T15:00:24.503 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.503 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.504 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:24.504 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2023-07-20T15:00:24.504 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2023-07-20T15:00:24.504 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2023-07-20T15:00:24.504 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:24.504 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2023-07-20T15:00:24.504 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.505 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.505 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.505 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.505 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2023-07-20T15:00:24.505 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2023-07-20T15:00:24.505 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:24.505 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.505 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.506 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2023-07-20T15:00:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2023-07-20T15:00:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2023-07-20T15:00:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2023-07-20T15:00:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.591 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.591 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2023-07-20T15:00:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2023-07-20T15:00:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2023-07-20T15:00:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2023-07-20T15:00:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2023-07-20T15:00:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2023-07-20T15:00:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-07-20T15:00:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2023-07-20T15:00:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2023-07-20T15:00:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2023-07-20T15:00:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2023-07-20T15:00:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2023-07-20T15:00:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:24.620 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2023-07-20T15:00:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2023-07-20T15:00:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2023-07-20T15:00:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:24.645 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:24.646 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.646 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.646 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.646 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2023-07-20T15:00:24.646 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-07-20T15:00:24.646 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.646 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.646 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.647 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2023-07-20T15:00:24.647 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2023-07-20T15:00:24.647 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:24.647 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.647 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.647 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2023-07-20T15:00:24.647 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.647 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.648 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.648 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2023-07-20T15:00:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2023-07-20T15:00:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2023-07-20T15:00:24.695 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:24.695 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.695 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:24.695 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2023-07-20T15:00:24.695 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.695 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.695 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.696 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2023-07-20T15:00:24.696 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.696 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.710 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.747 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.747 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2023-07-20T15:00:24.747 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2023-07-20T15:00:24.747 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:24.747 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.747 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:24.748 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2023-07-20T15:00:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.805 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.805 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2023-07-20T15:00:24.805 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.805 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.805 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.806 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.819 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2023-07-20T15:00:24.820 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2023-07-20T15:00:24.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:24.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:24.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2023-07-20T15:00:24.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.827 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.828 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2023-07-20T15:00:24.828 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.828 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.828 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.828 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.828 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:24.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:24.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:24.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:24.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:24.884 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:24.884 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:24.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:24.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:24.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:24.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:24.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:24.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:24.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:24.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:24.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:24.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:24.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:24.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2023-07-20T15:00:24.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.929 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:24.929 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:24.929 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:24.929 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.930 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.930 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:24.930 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.930 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.930 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:24.948 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:24.948 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:24.948 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:24.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:24.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:24.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:24.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:24.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:24.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:24.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:24.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:24.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:24.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:24.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:24.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:24.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:24.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:24.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:24.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:24.952 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2023-07-20T15:00:24.952 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2023-07-20T15:00:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2023-07-20T15:00:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:24.991 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:24.991 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2023-07-20T15:00:24.991 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2023-07-20T15:00:24.991 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:24.991 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2023-07-20T15:00:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2023-07-20T15:00:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2023-07-20T15:00:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.040 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:25.040 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.069 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.069 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.069 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2023-07-20T15:00:25.069 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2023-07-20T15:00:25.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2023-07-20T15:00:25.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:25.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2023-07-20T15:00:25.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.103 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2023-07-20T15:00:25.103 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2023-07-20T15:00:25.103 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.103 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.103 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.103 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:25.104 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.104 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.104 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.104 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-07-20T15:00:25.104 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2023-07-20T15:00:25.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2023-07-20T15:00:25.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:25.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.202 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.202 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.202 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-07-20T15:00:25.203 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.203 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.203 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.203 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:25.203 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:25.203 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:25.261 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2023-07-20T15:00:25.261 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:25.261 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:25.261 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:25.262 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:25.262 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:25.262 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:25.262 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.262 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:25.262 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:25.262 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.262 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.263 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:25.263 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:25.263 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:25.263 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:25.263 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:25.263 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:25.263 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:25.264 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:25.294 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.294 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.294 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.295 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.295 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.295 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:25.295 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:25.296 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.296 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.296 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:25.296 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:25.296 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.296 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.296 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.297 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.297 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.297 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.297 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.297 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.297 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:25.297 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:25.297 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:25.298 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.328 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:25.329 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:25.348 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.349 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.349 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:25.349 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:25.349 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:25.349 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:25.349 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:25.349 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:25.350 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:25.350 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:25.350 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.350 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.350 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.376 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.376 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.376 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:25.376 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:25.377 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.377 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.377 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:25.377 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:25.377 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.377 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.377 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.378 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.378 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.378 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.378 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.378 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.378 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2023-07-20T15:00:25.379 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2023-07-20T15:00:25.379 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:25.379 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.379 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:25.379 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2023-07-20T15:00:25.379 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.379 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.380 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.380 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2023-07-20T15:00:25.380 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.387 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.388 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.388 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.388 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2023-07-20T15:00:25.388 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2023-07-20T15:00:25.388 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:25.388 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.388 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:25.389 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2023-07-20T15:00:25.389 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.389 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.389 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.389 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2023-07-20T15:00:25.390 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.390 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.390 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.390 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:25.390 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:25.390 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.390 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2023-07-20T15:00:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2023-07-20T15:00:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2023-07-20T15:00:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:25.391 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.392 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.392 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:25.392 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.392 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.392 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.393 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.393 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.393 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.393 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.393 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.393 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2023-07-20T15:00:25.393 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2023-07-20T15:00:25.394 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.395 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.395 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.395 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:25.395 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.395 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.396 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.421 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.421 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.421 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.429 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.432 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.432 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2023-07-20T15:00:25.433 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2023-07-20T15:00:25.433 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.449 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.449 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.449 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:25.449 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.449 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.450 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.450 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.450 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.450 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.450 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.450 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.450 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2023-07-20T15:00:25.450 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2023-07-20T15:00:25.451 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.451 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.451 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.451 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:25.451 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.451 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.451 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.452 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.452 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.452 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.475 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.475 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.475 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2023-07-20T15:00:25.475 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2023-07-20T15:00:25.475 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.476 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.480 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:25.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2023-07-20T15:00:25.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2023-07-20T15:00:25.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.483 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.483 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:25.483 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.483 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.483 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.483 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.484 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.484 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.484 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2023-07-20T15:00:25.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2023-07-20T15:00:25.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.548 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.548 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:25.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2023-07-20T15:00:25.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2023-07-20T15:00:25.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.594 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.616 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.617 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:25.617 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.618 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.618 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.618 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.618 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.619 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.619 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.619 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.619 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2023-07-20T15:00:25.619 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2023-07-20T15:00:25.619 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.620 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.620 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.620 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:25.620 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.621 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.621 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.621 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.621 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.621 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.621 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.621 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.621 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2023-07-20T15:00:25.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2023-07-20T15:00:25.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:25.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.622 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-07-20T15:00:25.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-07-20T15:00:25.668 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:25.668 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.668 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.668 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:25.668 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.668 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.668 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2023-07-20T15:00:25.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2023-07-20T15:00:25.669 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2023-07-20T15:00:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.694 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2023-07-20T15:00:25.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2023-07-20T15:00:25.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.741 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.741 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:25.741 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.741 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.742 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.742 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.742 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.742 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.742 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.742 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2023-07-20T15:00:25.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2023-07-20T15:00:25.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:25.744 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.744 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:25.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.756 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.756 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.758 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.758 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2023-07-20T15:00:25.758 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2023-07-20T15:00:25.758 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:25.759 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.759 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.759 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2023-07-20T15:00:25.759 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.760 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.760 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.760 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2023-07-20T15:00:25.780 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-07-20T15:00:25.780 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.780 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.780 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.780 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:25.781 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.781 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.781 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.781 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.781 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2023-07-20T15:00:25.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2023-07-20T15:00:25.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.782 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:25.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.783 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.784 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.784 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.784 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2023-07-20T15:00:25.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2023-07-20T15:00:25.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:25.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.792 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.792 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:25.792 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.792 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.792 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.792 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.792 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.793 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.793 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.793 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.793 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-07-20T15:00:25.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-07-20T15:00:25.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.825 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.825 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:25.825 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.825 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.825 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.825 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.825 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.826 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.826 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.826 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.826 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-07-20T15:00:25.826 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-07-20T15:00:25.826 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.826 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.827 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.827 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:25.827 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.827 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.827 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.827 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.827 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.827 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.828 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.828 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-07-20T15:00:25.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-07-20T15:00:25.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:25.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.867 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.868 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.868 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.877 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.877 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.877 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.877 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.877 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-07-20T15:00:25.878 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-07-20T15:00:25.878 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.879 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.879 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.879 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:25.907 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.908 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.908 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.908 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.908 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.908 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.909 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.909 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.909 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-07-20T15:00:25.909 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-07-20T15:00:25.909 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.909 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.909 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:25.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.910 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-07-20T15:00:25.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-07-20T15:00:25.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:25.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:25.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:25.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:25.911 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:25.912 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:25.912 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:25.912 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:25.993 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:25.993 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:25.993 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:25.994 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:25.994 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-07-20T15:00:26.004 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-07-20T15:00:26.009 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:26.009 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.009 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.010 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:26.010 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.010 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.011 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.037 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.037 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.037 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.038 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.038 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.038 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2023-07-20T15:00:26.038 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2023-07-20T15:00:26.038 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:26.038 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.039 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.039 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:26.039 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.039 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.039 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.039 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.039 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.039 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.040 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.040 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.069 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2023-07-20T15:00:26.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2023-07-20T15:00:26.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:26.070 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-07-20T15:00:26.071 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.072 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.108 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.109 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.109 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.109 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.110 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.110 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.110 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2023-07-20T15:00:26.110 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-07-20T15:00:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2023-07-20T15:00:26.112 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.144 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.145 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.145 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.145 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.145 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.145 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.145 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.145 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2023-07-20T15:00:26.145 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2023-07-20T15:00:26.146 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:26.146 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.146 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.146 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2023-07-20T15:00:26.146 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.146 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.146 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.147 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.147 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.147 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.147 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.147 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.147 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2023-07-20T15:00:26.147 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2023-07-20T15:00:26.147 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:26.148 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.148 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.148 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2023-07-20T15:00:26.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2023-07-20T15:00:26.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2023-07-20T15:00:26.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:26.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:26.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2023-07-20T15:00:26.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2023-07-20T15:00:26.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:26.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.175 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2023-07-20T15:00:26.175 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.175 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.175 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.175 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.175 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2023-07-20T15:00:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2023-07-20T15:00:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2023-07-20T15:00:26.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2023-07-20T15:00:26.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:26.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2023-07-20T15:00:26.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2023-07-20T15:00:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2023-07-20T15:00:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:26.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.230 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2023-07-20T15:00:26.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.232 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.232 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2023-07-20T15:00:26.232 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2023-07-20T15:00:26.232 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:26.232 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.232 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.233 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:26.233 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.233 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.233 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.253 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2023-07-20T15:00:26.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2023-07-20T15:00:26.254 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:26.255 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.255 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:26.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.264 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.265 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.265 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.265 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.272 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.272 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.272 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2023-07-20T15:00:26.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2023-07-20T15:00:26.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:26.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:26.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2023-07-20T15:00:26.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2023-07-20T15:00:26.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:26.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2023-07-20T15:00:26.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.276 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.296 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.296 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.297 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.297 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.297 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2023-07-20T15:00:26.298 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-07-20T15:00:26.298 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:26.298 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.298 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.298 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2023-07-20T15:00:26.298 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.298 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.298 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.299 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.299 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.299 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.299 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.299 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.299 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2023-07-20T15:00:26.299 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-07-20T15:00:26.299 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:26.300 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.300 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.300 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2023-07-20T15:00:26.300 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.300 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.300 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.300 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.301 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.301 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.301 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.301 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.301 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2023-07-20T15:00:26.301 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2023-07-20T15:00:26.301 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:26.301 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.302 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.302 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:26.302 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.302 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.302 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.302 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.302 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2023-07-20T15:00:26.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2023-07-20T15:00:26.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:26.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.338 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:26.356 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2023-07-20T15:00:26.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.358 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2023-07-20T15:00:26.358 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2023-07-20T15:00:26.358 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:26.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2023-07-20T15:00:26.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2023-07-20T15:00:26.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2023-07-20T15:00:26.376 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:26.376 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.376 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.392 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:26.404 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.405 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.405 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.405 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.405 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.405 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.406 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.406 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.406 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:26.406 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:26.406 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:26.406 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.406 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:26.406 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:26.407 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.407 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.436 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:26.436 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:26.436 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:26.437 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:26.437 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:26.438 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:26.438 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:26.438 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:26.438 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.438 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.438 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.438 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.439 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.439 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:26.439 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:26.439 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:26.439 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.439 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:26.439 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:26.440 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.440 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.440 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.480 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.480 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.480 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:26.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:26.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:26.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:26.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:26.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:26.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:26.524 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:26.524 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:26.524 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:26.525 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:26.525 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:26.525 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:26.525 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.525 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.525 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.525 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.526 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:26.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.572 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2023-07-20T15:00:26.572 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2023-07-20T15:00:26.572 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:26.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:26.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.586 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.619 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.641 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.642 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2023-07-20T15:00:26.642 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2023-07-20T15:00:26.642 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:26.642 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.642 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.642 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2023-07-20T15:00:26.642 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.643 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.643 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.643 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.643 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.643 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.643 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.643 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.644 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2023-07-20T15:00:26.644 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2023-07-20T15:00:26.644 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2023-07-20T15:00:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.716 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.716 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2023-07-20T15:00:26.716 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2023-07-20T15:00:26.753 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:26.753 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.753 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.753 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:26.753 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2023-07-20T15:00:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2023-07-20T15:00:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2023-07-20T15:00:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2023-07-20T15:00:26.912 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2023-07-20T15:00:26.913 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:26.913 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.913 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.913 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2023-07-20T15:00:26.913 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.913 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.914 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:26.914 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:26.914 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2023-07-20T15:00:26.914 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:26.914 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.914 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.953 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.953 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.953 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.954 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2023-07-20T15:00:26.954 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2023-07-20T15:00:26.954 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:26.954 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.954 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2023-07-20T15:00:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2023-07-20T15:00:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2023-07-20T15:00:26.973 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.973 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.973 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.973 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.974 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.974 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.974 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2023-07-20T15:00:26.974 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2023-07-20T15:00:26.974 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:26.974 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.974 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:26.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.976 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.976 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.976 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.976 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:26.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:26.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:26.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:26.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2023-07-20T15:00:26.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2023-07-20T15:00:26.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:26.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:26.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:26.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:26.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:26.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:26.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:26.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:26.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.109 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.110 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.110 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:27.110 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:27.110 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.110 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2023-07-20T15:00:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2023-07-20T15:00:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2023-07-20T15:00:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.112 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:27.112 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:27.152 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.152 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.177 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2023-07-20T15:00:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:27.186 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:27.186 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:27.202 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.202 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:27.202 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:27.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:27.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:27.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:27.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:27.206 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:27.207 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:27.207 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:27.207 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:27.207 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:27.207 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.207 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.207 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.208 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.208 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:27.208 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:27.208 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:27.208 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.208 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:27.208 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:27.208 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.209 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.209 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.209 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:27.209 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.209 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.209 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.216 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.217 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:27.217 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:27.217 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:27.217 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.217 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:27.217 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:27.217 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:27.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:27.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:27.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:27.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:27.218 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:27.220 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:27.220 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:27.220 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:27.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:27.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:27.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2023-07-20T15:00:27.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2023-07-20T15:00:27.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:27.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:27.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2023-07-20T15:00:27.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2023-07-20T15:00:27.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.276 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.276 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.299 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2023-07-20T15:00:27.302 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2023-07-20T15:00:27.306 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:27.306 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.306 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:27.306 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2023-07-20T15:00:27.307 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.309 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.309 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.309 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2023-07-20T15:00:27.309 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.309 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.309 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.309 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2023-07-20T15:00:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2023-07-20T15:00:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:27.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2023-07-20T15:00:27.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2023-07-20T15:00:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2023-07-20T15:00:27.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2023-07-20T15:00:27.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:27.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.368 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:27.368 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2023-07-20T15:00:27.368 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.368 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.368 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.368 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2023-07-20T15:00:27.368 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2023-07-20T15:00:27.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2023-07-20T15:00:27.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:27.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.369 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:27.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:27.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.370 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2023-07-20T15:00:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2023-07-20T15:00:27.479 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2023-07-20T15:00:27.480 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:27.480 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.520 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:27.521 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2023-07-20T15:00:27.521 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.521 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.580 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2023-07-20T15:00:27.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.581 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2023-07-20T15:00:27.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2023-07-20T15:00:27.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:27.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:27.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2023-07-20T15:00:27.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.583 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2023-07-20T15:00:27.583 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.583 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.583 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.583 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:27.583 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:27.583 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.584 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:27.584 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2023-07-20T15:00:27.644 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:27.650 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:27.650 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:27.650 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:27.650 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:27.650 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:27.650 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.651 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:27.651 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:27.651 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.651 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.651 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:27.651 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:27.651 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:27.705 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:27.705 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:27.706 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:27.706 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:27.706 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:27.706 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:27.706 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.706 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.706 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:27.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:27.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:27.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:27.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:27.707 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:27.724 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.724 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:27.727 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:27.727 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:27.727 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:27.727 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:27.727 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:27.727 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:27.727 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.727 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.728 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.728 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.728 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:27.753 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:27.753 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:27.753 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.754 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:27.754 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:27.754 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.754 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.754 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.754 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:27.787 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.787 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.788 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.788 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.788 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2023-07-20T15:00:27.788 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2023-07-20T15:00:27.788 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:27.788 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.788 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:27.789 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2023-07-20T15:00:27.789 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.789 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.789 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.789 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:27.789 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.789 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.789 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2023-07-20T15:00:27.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2023-07-20T15:00:27.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:27.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:27.790 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2023-07-20T15:00:27.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:27.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.792 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.792 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2023-07-20T15:00:27.792 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2023-07-20T15:00:27.839 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:27.839 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.858 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:27.858 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2023-07-20T15:00:27.858 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.858 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.859 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.859 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:27.859 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.859 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.859 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.859 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:27.859 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:27.860 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.860 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:27.860 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2023-07-20T15:00:27.883 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2023-07-20T15:00:27.884 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2023-07-20T15:00:27.884 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:27.884 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2023-07-20T15:00:27.884 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2023-07-20T15:00:27.884 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:27.884 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:27.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2023-07-20T15:00:27.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.896 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.896 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.896 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:27.897 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.897 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.938 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.938 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.939 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2023-07-20T15:00:27.939 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2023-07-20T15:00:27.939 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:27.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.949 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:27.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2023-07-20T15:00:27.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.968 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.968 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:27.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2023-07-20T15:00:27.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2023-07-20T15:00:27.969 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:27.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:27.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:27.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:27.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:27.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:27.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:27.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:27.970 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:27.971 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:27.971 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:27.971 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:27.971 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2023-07-20T15:00:27.971 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2023-07-20T15:00:27.999 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2023-07-20T15:00:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:28.001 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:28.001 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:28.001 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:28.001 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:28.001 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:28.001 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:28.001 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.002 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:28.002 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:28.002 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.002 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.002 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:28.002 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:28.002 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:28.002 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:28.003 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:28.003 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:28.003 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:28.003 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:28.003 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.003 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:28.003 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:28.003 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:28.004 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:28.004 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:28.054 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:28.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:28.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.061 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:28.062 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:28.062 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.063 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.063 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:28.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:28.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:28.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:28.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:28.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:28.075 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.076 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:28.122 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:28.122 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.123 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.123 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:28.123 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:28.131 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:28.131 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.189 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:28.189 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:28.189 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:28.189 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:28.190 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2023-07-20T15:00:28.190 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2023-07-20T15:00:28.190 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:28.231 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.259 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:28.259 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:28.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:28.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:28.260 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:28.309 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:28.309 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:28.310 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2023-07-20T15:00:28.310 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2023-07-20T15:00:28.310 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:28.327 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.327 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:28.328 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2023-07-20T15:00:28.328 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.328 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.328 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:28.328 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.328 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:28.328 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:28.329 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:28.329 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:28.329 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2023-07-20T15:00:28.329 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2023-07-20T15:00:28.329 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:28.329 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.329 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:28.330 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2023-07-20T15:00:28.330 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.330 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.330 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:28.330 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.348 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:28.348 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:28.348 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:28.348 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2023-07-20T15:00:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2023-07-20T15:00:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.349 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:28.353 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2023-07-20T15:00:28.353 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.353 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.353 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:28.354 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.354 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:28.355 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:28.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:28.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:28.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2023-07-20T15:00:28.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2023-07-20T15:00:28.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:28.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:28.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:28.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:28.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:28.367 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:28.368 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:28.368 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:28.422 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2023-07-20T15:00:28.423 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2023-07-20T15:00:28.426 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:28.426 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.426 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:28.427 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2023-07-20T15:00:28.455 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.456 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.456 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:28.456 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.456 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:28.456 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:28.456 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:28.456 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:28.457 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:28.457 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:28.457 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:28.457 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2023-07-20T15:00:28.457 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:28.517 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:28.548 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:28.548 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:28.549 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:28.549 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:28.549 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.549 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:28.549 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:28.550 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.550 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.550 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:28.550 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:28.550 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:28.551 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:28.551 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:28.552 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:28.552 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:28.599 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:28.600 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.600 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:28.611 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:28.611 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:28.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:28.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:28.623 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:28.634 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.634 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:28.634 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:28.634 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:28.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:28.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:28.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:28.636 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:28.636 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:28.636 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:28.636 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:28.636 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.636 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:28.636 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:28.672 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.673 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.673 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:28.673 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:28.673 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:28.673 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:28.674 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:28.685 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:28.685 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:28.688 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:28.704 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:28.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:28.708 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:28.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:28.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:28.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:28.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:28.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:28.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:28.709 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.710 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.710 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:28.710 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.710 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:28.710 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:28.710 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:28.710 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:28.711 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:28.762 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:28.762 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:28.762 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2023-07-20T15:00:28.763 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:28.763 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:28.763 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:28.763 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:28.763 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:28.763 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:28.763 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.763 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:28.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:28.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:28.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:28.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:28.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:28.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:28.765 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:28.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:28.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:28.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:28.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:28.766 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:28.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:28.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:28.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.929 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:28.929 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:28.930 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:28.930 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:28.930 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:28.930 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:28.930 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:28.971 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:28.986 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:28.986 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:28.986 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:28.986 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:28.986 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:28.986 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:28.987 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:28.987 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:28.987 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:28.987 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:28.987 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:28.987 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:28.987 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:29.001 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:29.001 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:29.001 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:29.044 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:29.044 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:29.044 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:29.044 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:29.044 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:29.045 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:29.054 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:29.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:29.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:29.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:29.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:29.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:29.055 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:29.056 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:29.056 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:29.056 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:29.083 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:29.083 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2023-07-20T15:00:29.083 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:29.084 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:29.084 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:29.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2023-07-20T15:00:29.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2023-07-20T15:00:29.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:29.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:29.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:29.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2023-07-20T15:00:29.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:29.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:29.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:29.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2023-07-20T15:00:29.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:29.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:29.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:29.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:29.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2023-07-20T15:00:29.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2023-07-20T15:00:29.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:29.153 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:29.153 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:29.153 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2023-07-20T15:00:29.153 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2023-07-20T15:00:29.153 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:29.153 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2023-07-20T15:00:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:29.199 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:29.200 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:29.200 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:29.200 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:29.245 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:29.245 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:29.245 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:29.245 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:29.245 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:29.245 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:29.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:29.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:29.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:29.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:29.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:29.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:29.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:29.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:29.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:29.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:29.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:29.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:29.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:29.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:29.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:29.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:29.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:29.264 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:29.265 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:29.265 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:29.265 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:29.265 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:29.265 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:29.266 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:29.266 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:29.266 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:29.266 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:29.266 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:29.266 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:29.266 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:29.267 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:29.267 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:29.267 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:29.267 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:29.267 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:29.267 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:29.267 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:29.267 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:29.268 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:29.268 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:29.280 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:29.310 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:29.311 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:29.311 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:29.311 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:29.311 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:29.311 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:29.312 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:29.312 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:29.372 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:29.372 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:29.373 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:29.373 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:29.373 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:29.373 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:29.373 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:29.373 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:29.373 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:29.373 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:29.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:29.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:29.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:29.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:29.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:29.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2023-07-20T15:00:29.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:29.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:29.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:29.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2023-07-20T15:00:29.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2023-07-20T15:00:29.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:29.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:29.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:29.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2023-07-20T15:00:29.376 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:29.376 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:29.376 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:29.490 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2023-07-20T15:00:29.490 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:29.490 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:29.491 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:29.491 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:29.491 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:29.491 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:29.491 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:29.491 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:29.491 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:29.491 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:29.492 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:29.492 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:29.492 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:29.556 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:29.556 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:29.556 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:29.556 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:29.556 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:29.557 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:29.557 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:29.557 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:29.557 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:29.557 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:29.557 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:29.557 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:29.557 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:29.558 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:29.558 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:29.582 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:29.583 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:29.583 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:29.615 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:29.615 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:29.671 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:29.685 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:29.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:29.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:29.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:29.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:29.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:29.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:29.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:29.687 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:29.687 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:29.687 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:29.687 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:29.687 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:29.687 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:29.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:29.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:29.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:29.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:29.756 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:29.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:29.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:29.798 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:29.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:29.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:29.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:29.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:29.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:29.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:29.799 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:29.800 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:29.800 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:29.800 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:29.800 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:29.800 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:29.800 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:29.800 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2023-07-20T15:00:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2023-07-20T15:00:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:29.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:29.826 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:29.830 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:29.830 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:29.831 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:29.831 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2023-07-20T15:00:29.831 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:29.831 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:29.831 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:29.831 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:29.831 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2023-07-20T15:00:29.831 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2023-07-20T15:00:29.832 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:29.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:29.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:29.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2023-07-20T15:00:29.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:29.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:29.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:29.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2023-07-20T15:00:29.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:29.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:29.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:29.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:29.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2023-07-20T15:00:29.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2023-07-20T15:00:29.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:29.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:29.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:29.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2023-07-20T15:00:29.835 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:29.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:29.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:29.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2023-07-20T15:00:29.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:29.893 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:29.893 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:29.893 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:29.893 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2023-07-20T15:00:29.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2023-07-20T15:00:29.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:29.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:29.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:29.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:29.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:29.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:29.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:29.895 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2023-07-20T15:00:29.895 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:29.895 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:29.895 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:29.895 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:29.895 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2023-07-20T15:00:29.895 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2023-07-20T15:00:29.895 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:29.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:29.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:29.975 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2023-07-20T15:00:30.023 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.024 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.024 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:30.024 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2023-07-20T15:00:30.024 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:30.024 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:30.024 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:30.024 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:30.025 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:30.025 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:30.025 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:30.090 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2023-07-20T15:00:30.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:30.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:30.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:30.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:30.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:30.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:30.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:30.092 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:30.092 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:30.152 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.157 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.157 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:30.157 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:30.157 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:30.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:30.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:30.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:30.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:30.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:30.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:30.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:30.158 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:30.159 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:30.159 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:30.159 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:30.159 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:30.159 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:30.159 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:30.159 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:30.190 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:30.190 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.190 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.191 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:30.191 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:30.191 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:30.232 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:30.232 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:30.232 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:30.233 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:30.233 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:30.281 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:30.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:30.298 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:30.310 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:30.311 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:30.311 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:30.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:30.329 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:30.330 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:30.330 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:30.330 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:30.330 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:30.330 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:30.330 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:30.330 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:30.355 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.356 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.356 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:30.356 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:30.356 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:30.356 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:30.356 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:30.356 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:30.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2023-07-20T15:00:30.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2023-07-20T15:00:30.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:30.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:30.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:30.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:30.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.357 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.358 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:30.358 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2023-07-20T15:00:30.358 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2023-07-20T15:00:30.358 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2023-07-20T15:00:30.358 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:30.358 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2023-07-20T15:00:30.358 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:30.358 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:30.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:30.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:30.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:30.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:30.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:30.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2023-07-20T15:00:30.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:30.360 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:30.360 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:30.360 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:30.437 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:30.437 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:30.437 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:30.437 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:30.438 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:30.438 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.438 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.438 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:30.438 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:30.438 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:30.438 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:30.438 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:30.439 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:30.439 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:30.439 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:30.483 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:30.483 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:30.484 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:30.484 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:30.484 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:30.484 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:30.484 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:30.484 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:30.484 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:30.485 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:30.485 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:30.485 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.485 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.485 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:30.485 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:30.485 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:30.485 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:30.486 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:30.486 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:30.486 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:30.486 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:30.567 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:30.567 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:30.568 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:30.568 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:30.568 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.568 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.568 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:30.568 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:30.568 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:30.569 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:30.569 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:30.569 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:30.569 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:30.569 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:30.569 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:30.569 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:30.569 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:30.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:30.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:30.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:30.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:30.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:30.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:30.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:30.570 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:30.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:30.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:30.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:30.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:30.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:30.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:30.572 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:30.572 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2023-07-20T15:00:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:30.676 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.711 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:30.711 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:30.711 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:30.713 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:30.713 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:30.713 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:30.713 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:30.713 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:30.713 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:30.713 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:30.713 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:30.737 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:30.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:30.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:30.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:30.738 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:30.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:30.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:30.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:30.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:30.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:30.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:30.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:30.739 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:30.740 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.740 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.740 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:30.740 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:30.740 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:30.740 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:30.740 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:30.740 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:30.741 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:30.741 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:30.741 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:30.741 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:30.741 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:30.741 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:30.741 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:30.741 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:30.742 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:30.742 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:30.742 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:30.742 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:30.742 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:30.742 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.742 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.742 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:30.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:30.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:30.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:30.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:30.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:30.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2023-07-20T15:00:30.743 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2023-07-20T15:00:30.744 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:30.744 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:30.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:30.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2023-07-20T15:00:30.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:30.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:30.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:30.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:30.811 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:30.861 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:30.861 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:30.861 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:30.861 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:30.862 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2023-07-20T15:00:30.862 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:30.862 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:30.862 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:30.862 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:30.862 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:30.862 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:30.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:30.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:30.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:30.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:30.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:30.863 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:30.864 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:30.864 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:30.904 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:30.904 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:30.904 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:30.904 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:30.915 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:30.915 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.928 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.928 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:30.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:30.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:30.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:30.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:30.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:30.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:30.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:30.951 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:30.952 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:30.952 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:31.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:31.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:31.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:31.021 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:31.022 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:31.022 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:31.022 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:31.022 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:31.022 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:31.022 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:31.022 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:31.022 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2023-07-20T15:00:31.024 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2023-07-20T15:00:31.024 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:31.024 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:31.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:31.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2023-07-20T15:00:31.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:31.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:31.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:31.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2023-07-20T15:00:31.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:31.054 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:31.054 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:31.054 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:31.054 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2023-07-20T15:00:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2023-07-20T15:00:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:31.069 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2023-07-20T15:00:31.069 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:31.084 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:31.084 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:31.084 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2023-07-20T15:00:31.084 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:31.084 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:31.086 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:31.086 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:31.086 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2023-07-20T15:00:31.086 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:31.086 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:31.086 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:31.106 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:31.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:31.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:31.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:31.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:31.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:31.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:31.170 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:31.197 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:31.197 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:31.197 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:31.197 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:31.197 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:31.197 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:31.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:31.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:31.222 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:31.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:31.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:31.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:31.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:31.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:31.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:31.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:31.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:31.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:31.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:31.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:31.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:31.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:31.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:31.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:31.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:31.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:31.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:31.282 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:31.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:31.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:31.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:31.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:31.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:31.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:31.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:31.283 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:31.284 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:31.284 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:31.322 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:31.322 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:31.322 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:31.322 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:31.323 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:31.323 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:31.323 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:31.323 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:31.323 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:31.323 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:31.323 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:31.323 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:31.324 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:31.324 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:31.324 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:31.343 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:31.343 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:31.343 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:31.343 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:31.344 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:31.344 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:31.344 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2023-07-20T15:00:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2023-07-20T15:00:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:31.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:31.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:31.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:31.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:31.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:31.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:31.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:31.375 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:31.376 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2023-07-20T15:00:31.376 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2023-07-20T15:00:31.376 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:31.398 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:31.398 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:31.399 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:31.399 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:31.399 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:31.405 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:31.405 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:31.406 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:31.406 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:31.406 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:31.406 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:31.406 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2023-07-20T15:00:31.455 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2023-07-20T15:00:31.455 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:31.455 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:31.455 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:31.455 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:31.456 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:31.497 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:31.498 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:31.498 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:31.498 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:31.498 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:31.498 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:31.499 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:31.499 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2023-07-20T15:00:31.499 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2023-07-20T15:00:31.499 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:31.499 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:31.499 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:31.499 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:31.499 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:31.500 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:31.545 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:31.545 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:31.545 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:31.545 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:31.546 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:31.546 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2023-07-20T15:00:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2023-07-20T15:00:31.547 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:31.564 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:31.564 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:31.568 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:31.568 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:31.569 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:31.590 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:31.605 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:31.605 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:31.605 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:31.605 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:31.605 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:31.605 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:31.639 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:31.640 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:31.640 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2023-07-20T15:00:31.667 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:31.679 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:31.679 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:31.679 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:31.680 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:31.680 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:31.694 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:31.694 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:31.725 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:31.725 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:31.725 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:31.726 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:31.726 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:31.726 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:31.726 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:31.726 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:31.726 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:31.726 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:31.727 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:31.727 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:31.727 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:31.727 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:31.727 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:31.727 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:31.727 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:31.727 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:31.728 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:31.728 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:31.728 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:31.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:31.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:31.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:31.791 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:31.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:31.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:31.829 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:31.830 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:31.830 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:31.830 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:31.830 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:31.958 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:31.958 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:31.959 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:31.959 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:31.959 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:31.959 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:31.959 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:31.959 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:31.959 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:31.960 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:31.960 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:31.960 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:31.997 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:31.997 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:31.997 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:32.016 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:32.017 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.017 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.017 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.017 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.017 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.017 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.017 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.018 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.018 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2023-07-20T15:00:32.092 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2023-07-20T15:00:32.093 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.093 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.093 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:32.093 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.093 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2023-07-20T15:00:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2023-07-20T15:00:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.142 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.142 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.142 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:32.142 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:32.143 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.143 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:32.143 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2023-07-20T15:00:32.143 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:32.143 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:32.143 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:32.143 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2023-07-20T15:00:32.143 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2023-07-20T15:00:32.144 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.144 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:32.169 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:32.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:32.193 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.193 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.193 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:32.193 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:32.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:32.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:32.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:32.194 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:32.195 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:32.195 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:32.195 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:32.195 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.195 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.195 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.195 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.195 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.196 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:32.196 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:32.224 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:32.225 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.225 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:32.225 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:32.225 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.225 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.225 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.226 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.226 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.226 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.226 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.226 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.226 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:32.226 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:32.226 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.227 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.227 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:32.272 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:32.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:32.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:32.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:32.273 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:32.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:32.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:32.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:32.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:32.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.274 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:32.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:32.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:32.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:32.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:32.275 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.276 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.276 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.276 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.312 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.312 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.313 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.313 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.313 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2023-07-20T15:00:32.313 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2023-07-20T15:00:32.313 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.313 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.313 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:32.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.314 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2023-07-20T15:00:32.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2023-07-20T15:00:32.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:32.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.315 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.316 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.316 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.361 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.361 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.363 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.363 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.363 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:32.363 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:32.363 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.364 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:32.364 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2023-07-20T15:00:32.364 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:32.364 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:32.364 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:32.364 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:32.364 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:32.364 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.365 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.365 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:32.365 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.365 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.365 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.365 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:32.365 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:32.365 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:32.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:32.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:32.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:32.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:32.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:32.366 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.387 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.402 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.402 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.402 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.403 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:32.403 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:32.403 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:32.403 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.403 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:32.404 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:32.404 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.454 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.455 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.455 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.455 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.455 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.455 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.455 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.455 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:32.455 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:32.456 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.456 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:32.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:32.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.481 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:32.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:32.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:32.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:32.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:32.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:32.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:32.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:32.482 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.483 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.483 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.483 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.483 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.483 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:32.483 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:32.483 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:32.484 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.484 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:32.484 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:32.528 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.529 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.535 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.536 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.536 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.536 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.536 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.536 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:32.536 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:32.536 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:32.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2023-07-20T15:00:32.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:32.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:32.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:32.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:32.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:32.537 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:32.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:32.538 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:32.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:32.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:32.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:32.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:32.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:32.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:32.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.539 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:32.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:32.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:32.589 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.596 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:32.596 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:32.597 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.597 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.597 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.597 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.597 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.618 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.618 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.618 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.618 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:32.618 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:32.619 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.619 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.619 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:32.619 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:32.619 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.619 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.619 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:32.619 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:32.620 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:32.620 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:32.644 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:32.676 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:32.676 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:32.677 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:32.677 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.677 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.677 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.677 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.677 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.677 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:32.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:32.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:32.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:32.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:32.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.678 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.679 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.679 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.679 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.679 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.679 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.679 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2023-07-20T15:00:32.679 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2023-07-20T15:00:32.680 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.680 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.680 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:32.702 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.703 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.703 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.703 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.703 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.703 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.703 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.703 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.704 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.704 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2023-07-20T15:00:32.704 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2023-07-20T15:00:32.831 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.832 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.832 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:32.832 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2023-07-20T15:00:32.832 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.832 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.832 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2023-07-20T15:00:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2023-07-20T15:00:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:32.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.834 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2023-07-20T15:00:32.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2023-07-20T15:00:32.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:32.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.836 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:32.837 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.837 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.837 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.837 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.837 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.837 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.837 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.838 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.838 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.839 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2023-07-20T15:00:32.839 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2023-07-20T15:00:32.840 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2023-07-20T15:00:32.842 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.842 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:32.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.843 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.844 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.844 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.844 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.857 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.858 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.858 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2023-07-20T15:00:32.858 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2023-07-20T15:00:32.858 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.858 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.859 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:32.859 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.879 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.880 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.880 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.880 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.880 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.900 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.906 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.907 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.907 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2023-07-20T15:00:32.907 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2023-07-20T15:00:32.907 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:32.907 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.908 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:32.908 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.908 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.908 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.908 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.908 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.909 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.933 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.933 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.933 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.933 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2023-07-20T15:00:32.935 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2023-07-20T15:00:32.941 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:32.941 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.942 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:32.942 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:32.942 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.942 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.942 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.942 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.942 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.943 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.943 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.943 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.943 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2023-07-20T15:00:32.943 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2023-07-20T15:00:32.943 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.943 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.943 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:32.944 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.944 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.944 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.944 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.944 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.944 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.944 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.945 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.945 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.945 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2023-07-20T15:00:32.945 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2023-07-20T15:00:32.945 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.945 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.945 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:32.945 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.946 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.982 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.985 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.985 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.985 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.985 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.986 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.986 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.986 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2023-07-20T15:00:32.986 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2023-07-20T15:00:32.986 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.986 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.987 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:32.987 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.987 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.993 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.993 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.993 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.993 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.993 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.993 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2023-07-20T15:00:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:32.995 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:32.995 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:32.995 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:32.995 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:32.995 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:32.995 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.995 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:32.995 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:32.996 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.996 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.996 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:32.996 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:32.996 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:32.996 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:32.996 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:32.996 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:32.997 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:32.997 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:32.997 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.997 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.997 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.997 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:32.997 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:32.998 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:32.998 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:32.998 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:32.998 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:32.998 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:32.998 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:32.998 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:32.999 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:32.999 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:32.999 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:32.999 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:32.999 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:32.999 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:33.019 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:33.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:33.020 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.034 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:33.034 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:33.035 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.035 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.035 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:33.035 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:33.035 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:33.035 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:33.035 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:33.035 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:33.036 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:33.036 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:33.050 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.051 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.052 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.052 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:33.052 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:33.052 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:33.052 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.052 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:33.052 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:33.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.053 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.079 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.080 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.080 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:33.080 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:33.080 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.080 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:33.080 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2023-07-20T15:00:33.080 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:33.081 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:33.081 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:33.081 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2023-07-20T15:00:33.081 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2023-07-20T15:00:33.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:33.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:33.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2023-07-20T15:00:33.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.092 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.092 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.092 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.092 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.092 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.092 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.092 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.093 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2023-07-20T15:00:33.093 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2023-07-20T15:00:33.093 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:33.093 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.093 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:33.093 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2023-07-20T15:00:33.093 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.093 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:33.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.096 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:33.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:33.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:33.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:33.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:33.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:33.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:33.097 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:33.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:33.098 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.105 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.105 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:33.105 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:33.105 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:33.105 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.105 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:33.105 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:33.106 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.106 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.106 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:33.106 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:33.106 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:33.106 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:33.106 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:33.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:33.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:33.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:33.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.107 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.108 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:33.108 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:33.108 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:33.116 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.116 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:33.117 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:33.117 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.117 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.117 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.117 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.117 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.117 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.117 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:33.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:33.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:33.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2023-07-20T15:00:33.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:33.118 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:33.119 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:33.119 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2023-07-20T15:00:33.119 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2023-07-20T15:00:33.120 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:33.120 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:33.171 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:33.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.172 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2023-07-20T15:00:33.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2023-07-20T15:00:33.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2023-07-20T15:00:33.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:33.173 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:33.174 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:33.210 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.210 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.211 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.211 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.211 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.211 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.211 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.211 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.211 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2023-07-20T15:00:33.212 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2023-07-20T15:00:33.212 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:33.212 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.216 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:33.225 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2023-07-20T15:00:33.225 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.226 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.226 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.226 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.226 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.226 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.226 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.226 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2023-07-20T15:00:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2023-07-20T15:00:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.228 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.228 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.228 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.228 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2023-07-20T15:00:33.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2023-07-20T15:00:33.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:33.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.246 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:33.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:33.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.247 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2023-07-20T15:00:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2023-07-20T15:00:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:33.249 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.249 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.249 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.249 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.249 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.249 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.249 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.249 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.250 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2023-07-20T15:00:33.250 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2023-07-20T15:00:33.250 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:33.250 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.250 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:33.250 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2023-07-20T15:00:33.250 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.263 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.263 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.263 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.263 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.263 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.263 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.263 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.264 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2023-07-20T15:00:33.267 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2023-07-20T15:00:33.267 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:33.268 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.268 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:33.269 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:33.270 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.270 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.270 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.270 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.270 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.302 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.303 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.303 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.303 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2023-07-20T15:00:33.303 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2023-07-20T15:00:33.303 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2023-07-20T15:00:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2023-07-20T15:00:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2023-07-20T15:00:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2023-07-20T15:00:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.306 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:33.306 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2023-07-20T15:00:33.329 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.329 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.331 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.332 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.332 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.337 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.340 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.340 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.340 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2023-07-20T15:00:33.341 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2023-07-20T15:00:33.341 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:33.341 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.341 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:33.341 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:33.341 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.341 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.359 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.397 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:33.397 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:33.397 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:33.469 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:33.477 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:33.554 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:33.555 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:33.555 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:33.564 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.564 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.564 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.612 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:33.612 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:33.612 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.612 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.612 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.612 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.613 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.613 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.613 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.613 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.613 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:33.614 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:33.614 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:33.614 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.614 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:33.614 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:33.614 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.614 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.614 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:33.615 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:33.615 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:33.615 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:33.615 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:33.615 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:33.615 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:33.615 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:33.615 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.616 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.616 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.616 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.633 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.633 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:33.634 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:33.634 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:33.634 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.634 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:33.634 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:33.634 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.634 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.635 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.652 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.653 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.653 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.653 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2023-07-20T15:00:33.653 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2023-07-20T15:00:33.653 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:33.661 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.661 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:33.661 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:33.661 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2023-07-20T15:00:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2023-07-20T15:00:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.675 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.685 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2023-07-20T15:00:33.685 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2023-07-20T15:00:33.685 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:33.686 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.687 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:33.687 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2023-07-20T15:00:33.687 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.687 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.687 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.688 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.688 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.688 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.688 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.696 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:33.696 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:33.696 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.696 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:33.718 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2023-07-20T15:00:33.718 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:33.718 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:33.718 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:33.718 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:33.719 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:33.719 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:33.719 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.719 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:33.719 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:33.719 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.719 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.719 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:33.720 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:33.720 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:33.720 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:33.720 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:33.720 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:33.720 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:33.757 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.757 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.757 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.757 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.757 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.803 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.803 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.803 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.803 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:33.803 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:33.804 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:33.804 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.809 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:33.809 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:33.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:33.810 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:33.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:33.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:33.821 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:33.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:33.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:33.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:33.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.822 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:33.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:33.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:33.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:33.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:33.823 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.824 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.839 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.850 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.850 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.850 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.850 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:33.851 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:33.851 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.851 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:33.866 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2023-07-20T15:00:33.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:33.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:33.885 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:33.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:33.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:33.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:33.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:33.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:33.886 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:33.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:33.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:33.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:33.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:33.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:33.887 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:33.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:33.888 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.913 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.913 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.913 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.913 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.928 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:33.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:33.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:33.977 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:33.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:33.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:33.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:33.978 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:33.979 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:33.979 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:33.979 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:33.979 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:33.979 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:33.979 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:33.979 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:33.980 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:33.980 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:33.980 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:34.003 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:34.025 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:34.026 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:34.026 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:34.026 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:34.026 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:34.027 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:34.028 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:34.028 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:34.029 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:34.040 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:34.041 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:34.041 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:34.041 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:34.041 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:34.041 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:34.042 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:34.042 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:34.042 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:34.042 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:34.042 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:34.043 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:34.043 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:34.043 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:34.088 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:34.088 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:34.088 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:34.088 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2023-07-20T15:00:34.088 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2023-07-20T15:00:34.088 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2023-07-20T15:00:34.089 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2023-07-20T15:00:34.089 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2023-07-20T15:00:34.089 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2023-07-20T15:00:34.089 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:34.089 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:34.089 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:34.089 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2023-07-20T15:00:34.089 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:34.090 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:34.090 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:34.090 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:34.090 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:34.090 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:34.090 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:34.090 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:34.090 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2023-07-20T15:00:34.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2023-07-20T15:00:34.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:34.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:34.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:34.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:34.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:34.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:34.091 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:34.092 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:34.092 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:34.092 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:34.141 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:34.141 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:34.141 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2023-07-20T15:00:34.141 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2023-07-20T15:00:34.141 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2023-07-20T15:00:34.168 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:34.168 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:34.168 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2023-07-20T15:00:34.185 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:34.186 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:34.187 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:34.187 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:34.199 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:34.200 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:34.200 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:34.203 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:34.203 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2023-07-20T15:00:34.203 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2023-07-20T15:00:34.203 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2023-07-20T15:00:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:34.205 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:34.209 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:34.209 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:34.209 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:34.209 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:34.209 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:34.209 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:34.210 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:34.210 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:34.210 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:34.210 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2023-07-20T15:00:34.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2023-07-20T15:00:34.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:34.317 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:34.318 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:34.318 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:34.318 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:34.325 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:34.325 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:34.326 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:34.326 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:34.326 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:34.326 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:34.326 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:34.326 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2023-07-20T15:00:34.419 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2023-07-20T15:00:34.419 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:34.421 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:34.422 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:34.422 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2023-07-20T15:00:34.423 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:34.423 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:34.423 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2023-07-20T15:00:34.423 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2023-07-20T15:00:34.425 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2023-07-20T15:00:34.426 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2023-07-20T15:00:34.426 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2023-07-20T15:00:34.426 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2023-07-20T15:00:34.426 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2023-07-20T15:00:34.426 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:34.426 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:34.448 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:34.458 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:34.458 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:34.459 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:34.461 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2023-07-20T15:00:34.461 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2023-07-20T15:00:34.461 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2023-07-20T15:00:34.461 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:34.461 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2023-07-20T15:00:34.462 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2023-07-20T15:00:34.462 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:34.462 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:34.462 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:34.462 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:34.462 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:34.462 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:34.462 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:34.463 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:34.463 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2023-07-20T15:00:34.463 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2023-07-20T15:00:34.463 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:34.463 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:34.463 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:34.463 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2023-07-20T15:00:34.463 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:34.464 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:34.467 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:34.467 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:34.488 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:34.488 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:34.488 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:34.488 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:34.488 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2023-07-20T15:00:34.508 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2023-07-20T15:00:34.509 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2023-07-20T15:00:34.509 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:34.509 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:34.509 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2023-07-20T15:00:34.509 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:34.510 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:34.510 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:34.510 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:34.510 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:34.510 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:34.510 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:34.510 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:34.511 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2023-07-20T15:00:34.511 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2023-07-20T15:00:34.511 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2023-07-20T15:00:34.511 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2023-07-20T15:00:34.511 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2023-07-20T15:00:34.511 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2023-07-20T15:00:34.511 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2023-07-20T15:00:34.511 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2023-07-20T15:00:34.512 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2023-07-20T15:00:34.512 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2023-07-20T15:00:34.512 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2023-07-20T15:00:34.516 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2023-07-20T15:00:34.516 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2023-07-20T15:00:34.517 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:34.517 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:34.517 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:34.517 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:34.517 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2023-07-20T15:00:34.517 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2023-07-20T15:00:34.526 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2023-07-20T15:00:34.526 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2023-07-20T15:00:34.527 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2023-07-20T15:00:34.527 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2023-07-20T15:00:34.529 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2023-07-20T15:00:34.529 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2023-07-20T15:00:34.530 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2023-07-20T15:00:34.530 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2023-07-20T15:00:34.530 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2023-07-20T15:00:34.530 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:34.530 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2023-07-20T15:00:34.530 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2023-07-20T15:00:34.531 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2023-07-20T15:00:34.531 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2023-07-20T15:00:34.531 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2023-07-20T15:00:34.531 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2023-07-20T15:00:34.531 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2023-07-20T15:00:34.531 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2023-07-20T15:00:34.532 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2023-07-20T15:00:34.532 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2023-07-20T15:00:34.532 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2023-07-20T15:00:34.532 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2023-07-20T15:00:34.532 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2023-07-20T15:00:34.532 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 5, 2023-07-20T15:00:34.532 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2023-07-20T15:00:34.533 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:34.533 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2023-07-20T15:00:34.533 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:34.533 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2023-07-20T15:00:34.533 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.29:0", 2023-07-20T15:00:34.533 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 990615207 2023-07-20T15:00:34.533 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:34.533 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2023-07-20T15:00:34.534 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:34.534 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:34.534 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2023-07-20T15:00:34.534 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:34.534 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2023-07-20T15:00:34.534 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.29:0", 2023-07-20T15:00:34.534 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 3981441707 2023-07-20T15:00:34.534 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:34.535 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2023-07-20T15:00:34.535 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2023-07-20T15:00:34.535 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:34.535 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2023-07-20T15:00:34.535 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:34.535 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2023-07-20T15:00:34.535 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.29:0", 2023-07-20T15:00:34.535 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1786231591 2023-07-20T15:00:34.536 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:34.536 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2023-07-20T15:00:34.566 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:34.566 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2023-07-20T15:00:34.566 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:34.566 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:34.568 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:18 smithi029 bash[104935]: cluster 2023-07-20T15:00:17.779752+0000 mon.a (mon.0) 91 : cluster [DBG] mgrmap e12: y(active, since 2s) 2023-07-20T15:00:34.568 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Waiting for the mgr to restart... 2023-07-20T15:00:34.569 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Waiting for Mgr epoch 12... 2023-07-20T15:00:34.569 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2023-07-20T15:00:34.569 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2023-07-20T15:00:34.569 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:19 smithi029 bash[104935]: audit 2023-07-20T15:00:18.988639+0000 mon.a (mon.0) 92 : audit [DBG] from='client.? 172.21.15.29:0/2503741218' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2023-07-20T15:00:34.569 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:19 smithi029 bash[104935]: audit 2023-07-20T15:00:19.497501+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:19.496854\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:19.496955\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2023-07-20T15:00:19.497041\", \"networks\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:00:34.570 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:19 smithi029 bash[104935]: audit 2023-07-20T15:00:19.499249+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:19.496854\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:19.496955\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2023-07-20T15:00:19.497041\", \"networks\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:00:34.570 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:19 smithi029 bash[104935]: audit 2023-07-20T15:00:19.499728+0000 mon.a (mon.0) 95 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:00:34.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2023-07-20T15:00:34.571 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 12, 2023-07-20T15:00:34.572 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2023-07-20T15:00:34.572 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2023-07-20T15:00:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Generating a dashboard self-signed certificate... 2023-07-20T15:00:34.671 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'create-self-signed-cert'] 2023-07-20T15:00:34.671 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard create-self-signed-cert 2023-07-20T15:00:34.681 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Self-signed certificate created 2023-07-20T15:00:34.681 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Creating initial admin user... 2023-07-20T15:00:34.681 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'ac-user-create', 'admin', '9i8vdpcwpq', 'administrator', '--force-password', '--pwd-update-required'] 2023-07-20T15:00:34.682 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard ac-user-create admin 9i8vdpcwpq administrator --force-password --pwd-update-required 2023-07-20T15:00:34.700 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:21 smithi029 bash[104935]: audit 2023-07-20T15:00:21.257441+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIICzzCCAbcCEFCCUrRv8kbYnQ2sbkWZS7YwDQYJKoZIhvcNAQENBQAwJjELMAkG\nA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgtZGFzaGJvYXJkMB4XDTIzMDcyMDE1MDAy\nMVoXDTMzMDcxNzE1MDAyMVowJjELMAkGA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgt\nZGFzaGJvYXJkMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAlt1g0Arp\nAakizHVEi75cWgtw8Xl7cPRygs+4V59ZLOQv9BDvlv2tOYyxYjqULr7kxCNZhPPo\nnX7ZQXppnmkW1FKox4w8Cj+F8wU9iR3otCky5CqIEcl+ljMu0y6BRwoISlXtdtkB\nKhDANyzWvDosYIkRtZZ67DY4we7XLf5abIIpHlgncbg30FGt+QZWGhjx9P8V/y2l\nWE+3q52vVyIavsdwHy+pXF5hdzh33v4yf8XoCBJbyWzaGHcBTMyBCv065f7fOhcy\n64Q9ImKoB/9bawB+CJz+LDemSYcFoS6NpTU3Kn5Vh8zYY+0rqH9o+f51mb/lWs1W\njhmBoESXyoWYBwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBOHTChNYQHzpsxTPnR\nr1pbkJouNdl8futfiMAM/cs5C3hQEI2SX6u1Fm+hBDUothwiSSpqwxRs0sNohOvR\nvJK5MYzWs+ajhHoUfBYvci87ciTpw11lKgPBi/wnaS1vFLCq3qGygYqRWFvX0JD9\ngaZNU64kZqblIMaGTSH5ZRhvk/r5Tp2SCwu6wblokxUNZyKgOJ5QebvpecTzSG7j\nJm5OH9UX9Fief4TmkTufmkfqZ/JqDwgdOlRUVPiicCUyVHAMRuto9exKacZ1AbnQ\nrGnlDylWte8Y2CIMs6ABaqMDrcd4PtNwcqH6DiP4eEyoR1Y3nJuZKo2kNDi59J08\nl77F\n-----END CERTIFICATE-----\n"}]: dispatch 2023-07-20T15:00:34.746 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:21 smithi029 bash[104935]: audit 2023-07-20T15:00:21.259327+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIICzzCCAbcCEFCCUrRv8kbYnQ2sbkWZS7YwDQYJKoZIhvcNAQENBQAwJjELMAkG\nA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgtZGFzaGJvYXJkMB4XDTIzMDcyMDE1MDAy\nMVoXDTMzMDcxNzE1MDAyMVowJjELMAkGA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgt\nZGFzaGJvYXJkMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAlt1g0Arp\nAakizHVEi75cWgtw8Xl7cPRygs+4V59ZLOQv9BDvlv2tOYyxYjqULr7kxCNZhPPo\nnX7ZQXppnmkW1FKox4w8Cj+F8wU9iR3otCky5CqIEcl+ljMu0y6BRwoISlXtdtkB\nKhDANyzWvDosYIkRtZZ67DY4we7XLf5abIIpHlgncbg30FGt+QZWGhjx9P8V/y2l\nWE+3q52vVyIavsdwHy+pXF5hdzh33v4yf8XoCBJbyWzaGHcBTMyBCv065f7fOhcy\n64Q9ImKoB/9bawB+CJz+LDemSYcFoS6NpTU3Kn5Vh8zYY+0rqH9o+f51mb/lWs1W\njhmBoESXyoWYBwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBOHTChNYQHzpsxTPnR\nr1pbkJouNdl8futfiMAM/cs5C3hQEI2SX6u1Fm+hBDUothwiSSpqwxRs0sNohOvR\nvJK5MYzWs+ajhHoUfBYvci87ciTpw11lKgPBi/wnaS1vFLCq3qGygYqRWFvX0JD9\ngaZNU64kZqblIMaGTSH5ZRhvk/r5Tp2SCwu6wblokxUNZyKgOJ5QebvpecTzSG7j\nJm5OH9UX9Fief4TmkTufmkfqZ/JqDwgdOlRUVPiicCUyVHAMRuto9exKacZ1AbnQ\nrGnlDylWte8Y2CIMs6ABaqMDrcd4PtNwcqH6DiP4eEyoR1Y3nJuZKo2kNDi59J08\nl77F\n-----END CERTIFICATE-----\n"}]': finished 2023-07-20T15:00:34.746 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:21 smithi029 bash[104935]: audit 2023-07-20T15:00:21.259699+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQCW3WDQCukBqSLM\ndUSLvlxaC3DxeXtw9HKCz7hXn1ks5C/0EO+W/a05jLFiOpQuvuTEI1mE8+idftlB\nemmeaRbUUqjHjDwKP4XzBT2JHei0KTLkKogRyX6WMy7TLoFHCghKVe122QEqEMA3\nLNa8OixgiRG1lnrsNjjB7tct/lpsgikeWCdxuDfQUa35BlYaGPH0/xX/LaVYT7er\nna9XIhq+x3AfL6lcXmF3OHfe/jJ/xegIElvJbNoYdwFMzIEK/Trl/t86FzLrhD0i\nYqgH/1trAH4InP4sN6ZJhwWhLo2lNTcqflWHzNhj7Suof2j5/nWZv+VazVaOGYGg\nRJfKhZgHAgMBAAECggEAAxwnLcK70OvyqrJUKmlPMBACUQgHEmoHnki37R580R8X\nGfnrZnpuQrxyv6qjeV84Cg8MfmAk0HJX+jCS0tApx1C45/wtFK0AjuTxwszaCjS7\nNtblnTBBKsl9Up8nzRYY26dv0L5idsKHo9uJxbGRTqAkvFCQ0iPAAcdxqiIPLSNt\nqRTvGAQa4idX3CWc4RglXaGBAOF6rshh5RKrDgvQv3sfNWyhp2X4Sqm5QCwrxKLb\n/fb1DSqi47tAxcrVXMfA7RFfR5/YmSQd70wam1C7lqtvtg4sSE+r686mMe86u6f5\nd3mxx5UotP3I7mDcaKeskimvNvGNiNkEoa6B6iDPOQKBgQDHkZbL7EGLfH+uxoMb\nI5axBQgY08SCDUJlfyeHFZ9rHUGSTc3CxAiEsQb8VIa8hRedM9IYQ1YHTz9GeMt1\nvUgv0tBfXhTe4y7ekVKc7TTwGFLA5W0IV9noDdAGy0AIcc6+HKp1IX28oxSVSbSp\ng8M3GrKs+oB5xDYFB92jlpqtywKBgQDBhjM1EILRzBphEgU3CgV7iCY9tmeD4hAI\n8c180n6Oagb3rKbcKuHDpEWVtcegRZmE2J5v1z/ukj0hJM0YQxLlZoAae7mFrmFK\n+IQ37yTS5be1p3kKA15EfYyMpwwkxb3N3CaiktnCebHBu33bB43RkiREMetf1tvQ\n+ZV0jls3NQKBgQCXhDymFHhrC5nxOvw9NZbqTTSpjNZMGv8HCjQbhloju/GVv4Zx\n0d3ZyIHSP+aP6MhV7Qscqrr9D7itq3ZlrNDKplbXoRldY8So7FJ5nEqt4vmpREa0\np+ZkHWCMV/IEt0tM4Xy1MzlAZ9xvv6bvcH9dLeLsG8BBMqwEw8UNt4E2YwKBgQCv\nlRf+zEU1Hk7MxbHPlxsUUpoHoehXgxLzWpgK6VyDz/UUYCRgW9PMUs4DoBNH+f3o\nxzUw2gYaabpmyOIAYlLRqecOoDTZ8jY59DLaIPKzGlNM0G8EQ7wSvip4LtPYxUSJ\nc3XmSQCj7w/1aywsPrVQcJzQ9s3Mfb+g4eHVB5gBBQKBgEsepVsp/+Uxabc53ILu\nObhly0NX8gL9Rr1bd35DwueUvgT456zVPbgCIGEo6Bun9orABKbs8Nr5fBVPQGGm\ndoH7Mne3XQ9T+9XpGEO/4fbuFiFb1zVmTJ2Kvg9BZ0YgvsR5FMG0pPBqZdcQFXzu\n/MFTUmj5DRB7DoMPH6/utgzw\n-----END PRIVATE KEY-----\n"}]: dispatch 2023-07-20T15:00:34.746 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:21 smithi029 bash[104935]: audit 2023-07-20T15:00:21.260974+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQCW3WDQCukBqSLM\ndUSLvlxaC3DxeXtw9HKCz7hXn1ks5C/0EO+W/a05jLFiOpQuvuTEI1mE8+idftlB\nemmeaRbUUqjHjDwKP4XzBT2JHei0KTLkKogRyX6WMy7TLoFHCghKVe122QEqEMA3\nLNa8OixgiRG1lnrsNjjB7tct/lpsgikeWCdxuDfQUa35BlYaGPH0/xX/LaVYT7er\nna9XIhq+x3AfL6lcXmF3OHfe/jJ/xegIElvJbNoYdwFMzIEK/Trl/t86FzLrhD0i\nYqgH/1trAH4InP4sN6ZJhwWhLo2lNTcqflWHzNhj7Suof2j5/nWZv+VazVaOGYGg\nRJfKhZgHAgMBAAECggEAAxwnLcK70OvyqrJUKmlPMBACUQgHEmoHnki37R580R8X\nGfnrZnpuQrxyv6qjeV84Cg8MfmAk0HJX+jCS0tApx1C45/wtFK0AjuTxwszaCjS7\nNtblnTBBKsl9Up8nzRYY26dv0L5idsKHo9uJxbGRTqAkvFCQ0iPAAcdxqiIPLSNt\nqRTvGAQa4idX3CWc4RglXaGBAOF6rshh5RKrDgvQv3sfNWyhp2X4Sqm5QCwrxKLb\n/fb1DSqi47tAxcrVXMfA7RFfR5/YmSQd70wam1C7lqtvtg4sSE+r686mMe86u6f5\nd3mxx5UotP3I7mDcaKeskimvNvGNiNkEoa6B6iDPOQKBgQDHkZbL7EGLfH+uxoMb\nI5axBQgY08SCDUJlfyeHFZ9rHUGSTc3CxAiEsQb8VIa8hRedM9IYQ1YHTz9GeMt1\nvUgv0tBfXhTe4y7ekVKc7TTwGFLA5W0IV9noDdAGy0AIcc6+HKp1IX28oxSVSbSp\ng8M3GrKs+oB5xDYFB92jlpqtywKBgQDBhjM1EILRzBphEgU3CgV7iCY9tmeD4hAI\n8c180n6Oagb3rKbcKuHDpEWVtcegRZmE2J5v1z/ukj0hJM0YQxLlZoAae7mFrmFK\n+IQ37yTS5be1p3kKA15EfYyMpwwkxb3N3CaiktnCebHBu33bB43RkiREMetf1tvQ\n+ZV0jls3NQKBgQCXhDymFHhrC5nxOvw9NZbqTTSpjNZMGv8HCjQbhloju/GVv4Zx\n0d3ZyIHSP+aP6MhV7Qscqrr9D7itq3ZlrNDKplbXoRldY8So7FJ5nEqt4vmpREa0\np+ZkHWCMV/IEt0tM4Xy1MzlAZ9xvv6bvcH9dLeLsG8BBMqwEw8UNt4E2YwKBgQCv\nlRf+zEU1Hk7MxbHPlxsUUpoHoehXgxLzWpgK6VyDz/UUYCRgW9PMUs4DoBNH+f3o\nxzUw2gYaabpmyOIAYlLRqecOoDTZ8jY59DLaIPKzGlNM0G8EQ7wSvip4LtPYxUSJ\nc3XmSQCj7w/1aywsPrVQcJzQ9s3Mfb+g4eHVB5gBBQKBgEsepVsp/+Uxabc53ILu\nObhly0NX8gL9Rr1bd35DwueUvgT456zVPbgCIGEo6Bun9orABKbs8Nr5fBVPQGGm\ndoH7Mne3XQ9T+9XpGEO/4fbuFiFb1zVmTJ2Kvg9BZ0YgvsR5FMG0pPBqZdcQFXzu\n/MFTUmj5DRB7DoMPH6/utgzw\n-----END PRIVATE KEY-----\n"}]': finished 2023-07-20T15:00:34.776 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout {"username": "admin", "password": "$2b$12$Rf3Xfv/N54WN2758fndHCOmRDB5h/CZXnYOw5Ly/EJE4PG5vcV8NO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1689865222, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-07-20T15:00:34.777 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:22 smithi029 bash[104935]: audit 2023-07-20T15:00:21.164189+0000 mgr.y (mgr.14142) 1 : audit [DBG] from='client.14155 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:00:34.777 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:22 smithi029 bash[104935]: audit 2023-07-20T15:00:22.297471+0000 mon.a (mon.0) 100 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:00:34.778 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Fetching dashboard port number... 2023-07-20T15:00:34.778 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi029', '-v', '/var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'get', 'mgr', 'mgr/dashboard/ssl_server_port'] 2023-07-20T15:00:34.778 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi029 -v /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphgbaz45f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpv1d76ei3:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config get mgr mgr/dashboard/ssl_server_port 2023-07-20T15:00:34.778 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 8443 2023-07-20T15:00:34.792 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:23 smithi029 bash[104935]: audit 2023-07-20T15:00:22.162016+0000 mgr.y (mgr.14142) 2 : audit [DBG] from='client.14157 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "password": "9i8vdpcwpq", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:00:34.793 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:23 smithi029 bash[104935]: audit 2023-07-20T15:00:22.405226+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$Rf3Xfv/N54WN2758fndHCOmRDB5h/CZXnYOw5Ly/EJE4PG5vcV8NO\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1689865222, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]: dispatch 2023-07-20T15:00:34.793 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:23 smithi029 bash[104935]: audit 2023-07-20T15:00:22.406952+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$Rf3Xfv/N54WN2758fndHCOmRDB5h/CZXnYOw5Ly/EJE4PG5vcV8NO\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1689865222, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]': finished 2023-07-20T15:00:34.793 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:23 smithi029 bash[104935]: audit 2023-07-20T15:00:22.516117+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:19.496854\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:19.496955\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2023-07-20T15:00:19.497041\", \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:00:34.793 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:23 smithi029 bash[104935]: audit 2023-07-20T15:00:22.517872+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:19.496854\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:19.496955\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2023-07-20T15:00:19.497041\", \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:00:34.794 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Ceph Dashboard is now available at: 2023-07-20T15:00:34.795 INFO:teuthology.orchestra.run.smithi029.stderr: 2023-07-20T15:00:34.795 INFO:teuthology.orchestra.run.smithi029.stderr: URL: https://smithi029.front.sepia.ceph.com:8443/ 2023-07-20T15:00:34.795 INFO:teuthology.orchestra.run.smithi029.stderr: User: admin 2023-07-20T15:00:34.795 INFO:teuthology.orchestra.run.smithi029.stderr: Password: 9i8vdpcwpq 2023-07-20T15:00:34.795 INFO:teuthology.orchestra.run.smithi029.stderr: 2023-07-20T15:00:34.795 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:You can access the Ceph CLI with: 2023-07-20T15:00:34.796 INFO:teuthology.orchestra.run.smithi029.stderr: 2023-07-20T15:00:34.796 INFO:teuthology.orchestra.run.smithi029.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-07-20T15:00:34.796 INFO:teuthology.orchestra.run.smithi029.stderr: 2023-07-20T15:00:34.855 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Please consider enabling telemetry to help improve Ceph: 2023-07-20T15:00:34.855 INFO:teuthology.orchestra.run.smithi029.stderr: 2023-07-20T15:00:34.855 INFO:teuthology.orchestra.run.smithi029.stderr: ceph telemetry on 2023-07-20T15:00:34.855 INFO:teuthology.orchestra.run.smithi029.stderr: 2023-07-20T15:00:34.872 INFO:teuthology.orchestra.run.smithi029.stderr:For more information see: 2023-07-20T15:00:34.873 INFO:teuthology.orchestra.run.smithi029.stderr: 2023-07-20T15:00:34.889 INFO:teuthology.orchestra.run.smithi029.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2023-07-20T15:00:34.889 INFO:teuthology.orchestra.run.smithi029.stderr: 2023-07-20T15:00:34.889 INFO:teuthology.orchestra.run.smithi029.stderr:INFO:cephadm:Bootstrap complete. 2023-07-20T15:00:34.890 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Releasing lock 139719303125144 on /run/cephadm/021c9860-270e-11ee-9b34-001a4aab830c.lock 2023-07-20T15:00:34.890 INFO:teuthology.orchestra.run.smithi029.stderr:DEBUG:cephadm:Lock 139719303125144 released on /run/cephadm/021c9860-270e-11ee-9b34-001a4aab830c.lock 2023-07-20T15:00:34.891 INFO:tasks.cephadm:Fetching config... 2023-07-20T15:00:34.898 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-07-20T15:00:34.898 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-07-20T15:00:34.905 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:24 smithi029 bash[104935]: audit 2023-07-20T15:00:23.322267+0000 mon.a (mon.0) 105 : audit [DBG] from='client.? 172.21.15.29:0/2554211805' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-07-20T15:00:34.905 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:28 smithi029 bash[104935]: cluster 2023-07-20T15:00:27.751756+0000 mon.a (mon.0) 106 : cluster [DBG] mgrmap e13: y(active, since 12s) 2023-07-20T15:00:34.947 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-07-20T15:00:34.948 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-07-20T15:00:34.948 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-07-20T15:00:35.007 INFO:tasks.cephadm:Fetching mon keyring... 2023-07-20T15:00:35.008 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-07-20T15:00:35.008 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/mon.a/keyring of=/dev/stdout 2023-07-20T15:00:35.088 INFO:tasks.cephadm:Fetching pub ssh key... 2023-07-20T15:00:35.089 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-07-20T15:00:35.089 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-07-20T15:00:35.234 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-07-20T15:00:35.235 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9POsIs0QOESaiWueDPOo+t16vosuy16Kddv0bBbPLXu6GNvr687AHbWpFbldF6BZUV56zjnob0NoWOjCcO4uKQIMsMh7i0/B6fyZDgiisL9wRROeTkYEQvriRWUTQ/qtC/tc4arWUkpyuO62TkBLTSFgRm+t70E4Mkxl64pZ3ElnMguN1gUV9WpVRK/e1XACAUoND1jlPnC29/ZZZsokrsFwXF6cCOQ8DabyQ/obEF1XaGm3z0uCHKHBiQ2c8dwvOkX1yquTrVrspYnDGm/hNme2rxCkj/omqRTexA0/hIY7313aqPpmX0wNvEcf9g6NiVlEwsSkQES4jvlgt7uK3dpoASKFWgJmfV09RtsiBNx2yWD7oRnWFPsuOCFT3aGbbTll7Kz+FQjPd5TLoPpOXcYVYLXCzLuL7xOnLePzr/QUTr8M1UwSQJ6L2nrGwfZUTNhn6KPc+kGWlBcNbzKdN/H6ru8y3jEN8sTXu0IlrWxw7Oi1VT/Qt7db1GuFYN+c= ceph-021c9860-270e-11ee-9b34-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-07-20T15:00:35.383 INFO:teuthology.orchestra.run.smithi029.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9POsIs0QOESaiWueDPOo+t16vosuy16Kddv0bBbPLXu6GNvr687AHbWpFbldF6BZUV56zjnob0NoWOjCcO4uKQIMsMh7i0/B6fyZDgiisL9wRROeTkYEQvriRWUTQ/qtC/tc4arWUkpyuO62TkBLTSFgRm+t70E4Mkxl64pZ3ElnMguN1gUV9WpVRK/e1XACAUoND1jlPnC29/ZZZsokrsFwXF6cCOQ8DabyQ/obEF1XaGm3z0uCHKHBiQ2c8dwvOkX1yquTrVrspYnDGm/hNme2rxCkj/omqRTexA0/hIY7313aqPpmX0wNvEcf9g6NiVlEwsSkQES4jvlgt7uK3dpoASKFWgJmfV09RtsiBNx2yWD7oRnWFPsuOCFT3aGbbTll7Kz+FQjPd5TLoPpOXcYVYLXCzLuL7xOnLePzr/QUTr8M1UwSQJ6L2nrGwfZUTNhn6KPc+kGWlBcNbzKdN/H6ru8y3jEN8sTXu0IlrWxw7Oi1VT/Qt7db1GuFYN+c= ceph-021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T15:00:35.384 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9POsIs0QOESaiWueDPOo+t16vosuy16Kddv0bBbPLXu6GNvr687AHbWpFbldF6BZUV56zjnob0NoWOjCcO4uKQIMsMh7i0/B6fyZDgiisL9wRROeTkYEQvriRWUTQ/qtC/tc4arWUkpyuO62TkBLTSFgRm+t70E4Mkxl64pZ3ElnMguN1gUV9WpVRK/e1XACAUoND1jlPnC29/ZZZsokrsFwXF6cCOQ8DabyQ/obEF1XaGm3z0uCHKHBiQ2c8dwvOkX1yquTrVrspYnDGm/hNme2rxCkj/omqRTexA0/hIY7313aqPpmX0wNvEcf9g6NiVlEwsSkQES4jvlgt7uK3dpoASKFWgJmfV09RtsiBNx2yWD7oRnWFPsuOCFT3aGbbTll7Kz+FQjPd5TLoPpOXcYVYLXCzLuL7xOnLePzr/QUTr8M1UwSQJ6L2nrGwfZUTNhn6KPc+kGWlBcNbzKdN/H6ru8y3jEN8sTXu0IlrWxw7Oi1VT/Qt7db1GuFYN+c= ceph-021c9860-270e-11ee-9b34-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-07-20T15:00:35.494 INFO:teuthology.orchestra.run.smithi178.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9POsIs0QOESaiWueDPOo+t16vosuy16Kddv0bBbPLXu6GNvr687AHbWpFbldF6BZUV56zjnob0NoWOjCcO4uKQIMsMh7i0/B6fyZDgiisL9wRROeTkYEQvriRWUTQ/qtC/tc4arWUkpyuO62TkBLTSFgRm+t70E4Mkxl64pZ3ElnMguN1gUV9WpVRK/e1XACAUoND1jlPnC29/ZZZsokrsFwXF6cCOQ8DabyQ/obEF1XaGm3z0uCHKHBiQ2c8dwvOkX1yquTrVrspYnDGm/hNme2rxCkj/omqRTexA0/hIY7313aqPpmX0wNvEcf9g6NiVlEwsSkQES4jvlgt7uK3dpoASKFWgJmfV09RtsiBNx2yWD7oRnWFPsuOCFT3aGbbTll7Kz+FQjPd5TLoPpOXcYVYLXCzLuL7xOnLePzr/QUTr8M1UwSQJ6L2nrGwfZUTNhn6KPc+kGWlBcNbzKdN/H6ru8y3jEN8sTXu0IlrWxw7Oi1VT/Qt7db1GuFYN+c= ceph-021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T15:00:35.543 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi178 2023-07-20T15:00:35.564 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-07-20T15:00:35.564 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/etc/ceph/ceph.conf 2023-07-20T15:00:35.669 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-07-20T15:00:35.670 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-20T15:00:35.857 INFO:tasks.cephadm:Adding host smithi178 to orchestrator... 2023-07-20T15:00:35.925 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph orch host add smithi178 2023-07-20T15:00:37.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:36 smithi029 bash[104935]: cluster 2023-07-20T15:00:35.781322+0000 mgr.y (mgr.14142) 3 : cluster [DBG] pgmap v3: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:00:39.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:38 smithi029 bash[104935]: cluster 2023-07-20T15:00:37.781745+0000 mgr.y (mgr.14142) 4 : cluster [DBG] pgmap v4: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:00:41.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:40 smithi029 bash[104935]: cluster 2023-07-20T15:00:39.782179+0000 mgr.y (mgr.14142) 5 : cluster [DBG] pgmap v5: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:00:42.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:41 smithi029 bash[104935]: cluster 2023-07-20T15:00:41.782412+0000 mgr.y (mgr.14142) 6 : cluster [DBG] pgmap v6: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:00:44.225 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:43 smithi029 bash[104935]: cluster 2023-07-20T15:00:43.782715+0000 mgr.y (mgr.14142) 7 : cluster [DBG] pgmap v7: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:00:46.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:45 smithi029 bash[104935]: cluster 2023-07-20T15:00:45.782958+0000 mgr.y (mgr.14142) 8 : cluster [DBG] pgmap v8: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:00:48.195 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:47 smithi029 bash[104935]: cluster 2023-07-20T15:00:47.783365+0000 mgr.y (mgr.14142) 9 : cluster [DBG] pgmap v9: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:00:49.461 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:00:49 smithi029 bash[105170]: Warning: Permanently added 'smithi178,172.21.15.178' (ECDSA) to the list of known hosts. 2023-07-20T15:00:49.956 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:49 smithi029 bash[104935]: audit 2023-07-20T15:00:49.570833+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"smithi029\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"smithi178\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2023-07-20T15:00:49.956 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:49 smithi029 bash[104935]: audit 2023-07-20T15:00:49.573100+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"smithi029\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"smithi178\", \"labels\": [], \"status\": \"\"}}"}]': finished 2023-07-20T15:00:50.164 INFO:teuthology.orchestra.run.smithi178.stdout:Added host 'smithi178' 2023-07-20T15:00:50.704 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph orch host ls --format=json 2023-07-20T15:00:50.948 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:50 smithi029 bash[104935]: audit 2023-07-20T15:00:49.101459+0000 mgr.y (mgr.14142) 10 : audit [DBG] from='client.14161 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:00:50.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:50 smithi029 bash[104935]: cephadm 2023-07-20T15:00:49.573577+0000 mgr.y (mgr.14142) 11 : cephadm [INF] Added host smithi178 2023-07-20T15:00:50.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:50 smithi029 bash[104935]: audit 2023-07-20T15:00:49.771036+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:00:50.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:50 smithi029 bash[104935]: audit 2023-07-20T15:00:49.772685+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:00:50.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:50 smithi029 bash[104935]: audit 2023-07-20T15:00:49.773328+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:00:50.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:50 smithi029 bash[104935]: cluster 2023-07-20T15:00:49.783739+0000 mgr.y (mgr.14142) 12 : cluster [DBG] pgmap v10: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:00:50.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:50 smithi029 bash[104935]: audit 2023-07-20T15:00:49.947882+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2023-07-20T15:00:49.947544\", \"networks\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:00:50.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:50 smithi029 bash[104935]: audit 2023-07-20T15:00:49.949708+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2023-07-20T15:00:49.947544\", \"networks\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:00:50.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:50 smithi029 bash[104935]: audit 2023-07-20T15:00:49.950292+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:00:52.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:51 smithi029 bash[104935]: cluster 2023-07-20T15:00:51.784045+0000 mgr.y (mgr.14142) 13 : cluster [DBG] pgmap v11: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:00:52.391 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-07-20T15:00:52.392 INFO:teuthology.orchestra.run.smithi178.stdout:[{"addr": "smithi029", "hostname": "smithi029", "labels": [], "status": ""}, {"addr": "smithi178", "hostname": "smithi178", "labels": [], "status": ""}] 2023-07-20T15:00:52.866 INFO:tasks.cephadm:Setting crush tunables to default 2023-07-20T15:00:52.866 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph osd crush tunables default 2023-07-20T15:00:53.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:52 smithi029 bash[104935]: audit 2023-07-20T15:00:52.345139+0000 mgr.y (mgr.14142) 14 : audit [DBG] from='client.14163 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-20T15:00:53.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:52 smithi029 bash[104935]: audit 2023-07-20T15:00:52.480408+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:00:53.213 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:52 smithi029 bash[104935]: audit 2023-07-20T15:00:52.665334+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2023-07-20T15:00:49.947544\", \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:00:53.214 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:52 smithi029 bash[104935]: audit 2023-07-20T15:00:52.667552+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2023-07-20T15:00:49.947544\", \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:00:54.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:53 smithi029 bash[104935]: cluster 2023-07-20T15:00:53.784278+0000 mgr.y (mgr.14142) 15 : cluster [DBG] pgmap v12: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:00:54.924 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2023-07-20T15:00:55.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:54 smithi029 bash[104935]: audit 2023-07-20T15:00:54.003533+0000 mon.a (mon.0) 118 : audit [INF] from='client.? 172.21.15.29:0/1221155656' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-07-20T15:00:55.372 INFO:tasks.cephadm:Adding mon.c on smithi029 2023-07-20T15:00:55.373 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph orch daemon add mon 'smithi029:[v2:172.21.15.29:3301,v1:172.21.15.29:6790]=c' 2023-07-20T15:00:56.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:55 smithi029 bash[104935]: audit 2023-07-20T15:00:54.877838+0000 mon.a (mon.0) 119 : audit [INF] from='client.? 172.21.15.29:0/1221155656' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-07-20T15:00:56.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:55 smithi029 bash[104935]: cluster 2023-07-20T15:00:54.877885+0000 mon.a (mon.0) 120 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2023-07-20T15:00:56.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:55 smithi029 bash[104935]: cluster 2023-07-20T15:00:55.784649+0000 mgr.y (mgr.14142) 16 : cluster [DBG] pgmap v14: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:00:57.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:56 smithi029 bash[104935]: audit 2023-07-20T15:00:56.618474+0000 mgr.y (mgr.14142) 17 : audit [DBG] from='client.14167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi029:[v2:172.21.15.29:3301,v1:172.21.15.29:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:00:57.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:56 smithi029 bash[104935]: audit 2023-07-20T15:00:56.620075+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:00:57.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:56 smithi029 bash[104935]: audit 2023-07-20T15:00:56.620668+0000 mon.a (mon.0) 122 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:00:57.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:56 smithi029 bash[104935]: cephadm 2023-07-20T15:00:56.621082+0000 mgr.y (mgr.14142) 18 : cephadm [INF] Deploying daemon mon.c on smithi029 2023-07-20T15:00:57.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:56 smithi029 bash[104935]: audit 2023-07-20T15:00:56.621301+0000 mon.a (mon.0) 123 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2023-07-20T15:00:58.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:00:57 smithi029 bash[104935]: cluster 2023-07-20T15:00:57.784967+0000 mgr.y (mgr.14142) 19 : cluster [DBG] pgmap v15: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:00:58.665 INFO:teuthology.orchestra.run.smithi029.stdout:Deployed mon.c on host 'smithi029' 2023-07-20T15:00:59.042 DEBUG:teuthology.orchestra.run.smithi029:mon.c> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.c.service 2023-07-20T15:00:59.054 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-07-20T15:00:59.054 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph mon dump -f json 2023-07-20T15:00:59.078 INFO:journalctl@ceph.mon.c.smithi029.stdout:-- Logs begin at Thu 2023-07-20 14:49:36 UTC. -- 2023-07-20T15:01:04.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[104935]: cluster 2023-07-20T15:00:58.686961+0000 mon.a (mon.0) 127 : cluster [INF] mon.a calling monitor election 2023-07-20T15:01:04.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[104935]: audit 2023-07-20T15:00:59.413656+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412802\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}}, \"last_daemon_update\": \"2023-07-20T15:00:59.412989\", \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:04.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[108361]: cluster 2023-07-20T15:00:58.686961+0000 mon.a (mon.0) 127 : cluster [INF] mon.a calling monitor election 2023-07-20T15:01:04.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[108361]: audit 2023-07-20T15:00:59.413656+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412802\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}}, \"last_daemon_update\": \"2023-07-20T15:00:59.412989\", \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:04.207 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[104935]: cluster 2023-07-20T15:00:59.785314+0000 mgr.y (mgr.14142) 20 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:04.208 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[104935]: cluster 2023-07-20T15:01:00.685278+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2023-07-20T15:01:04.235 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[104935]: cluster 2023-07-20T15:01:01.785635+0000 mgr.y (mgr.14142) 21 : cluster [DBG] pgmap v17: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:04.235 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[104935]: cluster 2023-07-20T15:01:03.712884+0000 mon.a (mon.0) 129 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-20T15:01:04.235 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[104935]: cluster 2023-07-20T15:01:03.715676+0000 mon.a (mon.0) 130 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],c=[v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0]} 2023-07-20T15:01:04.236 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[104935]: cluster 2023-07-20T15:01:03.715722+0000 mon.a (mon.0) 131 : cluster [DBG] fsmap 2023-07-20T15:01:04.236 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[104935]: cluster 2023-07-20T15:01:03.715747+0000 mon.a (mon.0) 132 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2023-07-20T15:01:04.236 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[104935]: cluster 2023-07-20T15:01:03.715973+0000 mon.a (mon.0) 133 : cluster [DBG] mgrmap e13: y(active, since 48s) 2023-07-20T15:01:04.237 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[104935]: audit 2023-07-20T15:01:03.716580+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412802\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}}, \"last_daemon_update\": \"2023-07-20T15:00:59.412989\", \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:04.237 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[104935]: cluster 2023-07-20T15:01:03.719236+0000 mon.a (mon.0) 135 : cluster [INF] overall HEALTH_OK 2023-07-20T15:01:04.237 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[104935]: audit 2023-07-20T15:01:03.721108+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412802\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}}, \"last_daemon_update\": \"2023-07-20T15:00:59.412989\", \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:04.238 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[108361]: cluster 2023-07-20T15:00:59.785314+0000 mgr.y (mgr.14142) 20 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:04.238 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[108361]: cluster 2023-07-20T15:01:00.685278+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2023-07-20T15:01:04.278 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[108361]: cluster 2023-07-20T15:01:01.785635+0000 mgr.y (mgr.14142) 21 : cluster [DBG] pgmap v17: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:04.290 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[108361]: cluster 2023-07-20T15:01:03.712884+0000 mon.a (mon.0) 129 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-20T15:01:04.291 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[108361]: cluster 2023-07-20T15:01:03.715676+0000 mon.a (mon.0) 130 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],c=[v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0]} 2023-07-20T15:01:04.291 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[108361]: cluster 2023-07-20T15:01:03.715722+0000 mon.a (mon.0) 131 : cluster [DBG] fsmap 2023-07-20T15:01:04.291 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[108361]: cluster 2023-07-20T15:01:03.715747+0000 mon.a (mon.0) 132 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2023-07-20T15:01:04.291 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[108361]: cluster 2023-07-20T15:01:03.715973+0000 mon.a (mon.0) 133 : cluster [DBG] mgrmap e13: y(active, since 48s) 2023-07-20T15:01:04.294 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[108361]: audit 2023-07-20T15:01:03.716580+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412802\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}}, \"last_daemon_update\": \"2023-07-20T15:00:59.412989\", \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:04.295 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[108361]: cluster 2023-07-20T15:01:03.719236+0000 mon.a (mon.0) 135 : cluster [INF] overall HEALTH_OK 2023-07-20T15:01:04.295 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:03 smithi029 bash[108361]: audit 2023-07-20T15:01:03.721108+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412802\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}}, \"last_daemon_update\": \"2023-07-20T15:00:59.412989\", \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:04.458 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T15:01:04.458 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":2,"fsid":"021c9860-270e-11ee-9b34-001a4aab830c","modified":"2023-07-20T15:00:58.684567Z","created":"2023-07-20T14:59:39.669074Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3301","nonce":0},{"type":"v1","addr":"172.21.15.29:6790","nonce":0}]},"addr":"172.21.15.29:6790/0","public_addr":"172.21.15.29:6790/0","priority":0,"weight":0}],"quorum":[0,1]} 2023-07-20T15:01:04.484 INFO:teuthology.orchestra.run.smithi029.stderr:dumped monmap epoch 2 2023-07-20T15:01:04.827 INFO:tasks.cephadm:Adding mon.b on smithi178 2023-07-20T15:01:04.828 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph orch daemon add mon smithi178:172.21.15.178=b 2023-07-20T15:01:05.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:04 smithi029 bash[104935]: cluster 2023-07-20T15:01:03.786023+0000 mgr.y (mgr.14142) 22 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:05.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:04 smithi029 bash[104935]: audit 2023-07-20T15:01:04.384257+0000 mon.a (mon.0) 137 : audit [DBG] from='client.? 172.21.15.29:0/1129420960' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-20T15:01:05.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:04 smithi029 bash[108361]: cluster 2023-07-20T15:01:03.786023+0000 mgr.y (mgr.14142) 22 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:05.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:04 smithi029 bash[108361]: audit 2023-07-20T15:01:04.384257+0000 mon.a (mon.0) 137 : audit [DBG] from='client.? 172.21.15.29:0/1129420960' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-20T15:01:06.227 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:05 smithi029 bash[104935]: cluster 2023-07-20T15:01:05.786342+0000 mgr.y (mgr.14142) 23 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:06.228 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:05 smithi029 bash[108361]: cluster 2023-07-20T15:01:05.786342+0000 mgr.y (mgr.14142) 23 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:07.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:06 smithi029 bash[104935]: audit 2023-07-20T15:01:06.041487+0000 mgr.y (mgr.14142) 24 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi178:172.21.15.178=b", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:01:07.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:06 smithi029 bash[104935]: audit 2023-07-20T15:01:06.042891+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:01:07.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:06 smithi029 bash[104935]: audit 2023-07-20T15:01:06.043680+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:07.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:06 smithi029 bash[104935]: cephadm 2023-07-20T15:01:06.044272+0000 mgr.y (mgr.14142) 25 : cephadm [INF] Deploying daemon mon.b on smithi178 2023-07-20T15:01:07.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:06 smithi029 bash[104935]: audit 2023-07-20T15:01:06.044563+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2023-07-20T15:01:07.239 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:06 smithi029 bash[108361]: audit 2023-07-20T15:01:06.041487+0000 mgr.y (mgr.14142) 24 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi178:172.21.15.178=b", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:01:07.240 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:06 smithi029 bash[108361]: audit 2023-07-20T15:01:06.042891+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:01:07.240 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:06 smithi029 bash[108361]: audit 2023-07-20T15:01:06.043680+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:07.251 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:06 smithi029 bash[108361]: cephadm 2023-07-20T15:01:06.044272+0000 mgr.y (mgr.14142) 25 : cephadm [INF] Deploying daemon mon.b on smithi178 2023-07-20T15:01:07.252 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:06 smithi029 bash[108361]: audit 2023-07-20T15:01:06.044563+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2023-07-20T15:01:08.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:07 smithi029 bash[104935]: cluster 2023-07-20T15:01:07.786722+0000 mgr.y (mgr.14142) 26 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:08.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:07 smithi029 bash[108361]: cluster 2023-07-20T15:01:07.786722+0000 mgr.y (mgr.14142) 26 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:09.128 INFO:teuthology.orchestra.run.smithi178.stdout:Deployed mon.b on host 'smithi178' 2023-07-20T15:01:09.477 DEBUG:teuthology.orchestra.run.smithi178:mon.b> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.b.service 2023-07-20T15:01:09.517 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-07-20T15:01:09.517 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph mon dump -f json 2023-07-20T15:01:09.518 INFO:journalctl@ceph.mon.b.smithi178.stdout:-- Logs begin at Thu 2023-07-20 14:49:59 UTC. -- 2023-07-20T15:01:14.221 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[104935]: cluster 2023-07-20T15:01:08.676671+0000 mon.a (mon.0) 144 : cluster [INF] mon.a calling monitor election 2023-07-20T15:01:14.222 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[104935]: cluster 2023-07-20T15:01:08.676984+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2023-07-20T15:01:14.222 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[104935]: audit 2023-07-20T15:01:09.048600+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:09.047881\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}}, \"last_daemon_update\": \"2023-07-20T15:01:09.048032\", \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:01:14.222 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[104935]: cluster 2023-07-20T15:01:09.787126+0000 mgr.y (mgr.14142) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:14.222 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[104935]: cluster 2023-07-20T15:01:11.787478+0000 mgr.y (mgr.14142) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:14.250 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[104935]: cluster 2023-07-20T15:01:13.689271+0000 mon.a (mon.0) 146 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-20T15:01:14.251 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[104935]: cluster 2023-07-20T15:01:13.691992+0000 mon.a (mon.0) 147 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],b=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0],c=[v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0]} 2023-07-20T15:01:14.251 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[104935]: cluster 2023-07-20T15:01:13.692034+0000 mon.a (mon.0) 148 : cluster [DBG] fsmap 2023-07-20T15:01:14.251 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[108361]: cluster 2023-07-20T15:01:08.676671+0000 mon.a (mon.0) 144 : cluster [INF] mon.a calling monitor election 2023-07-20T15:01:14.252 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[108361]: cluster 2023-07-20T15:01:08.676984+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2023-07-20T15:01:14.252 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[108361]: audit 2023-07-20T15:01:09.048600+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:09.047881\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}}, \"last_daemon_update\": \"2023-07-20T15:01:09.048032\", \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:01:14.252 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[108361]: cluster 2023-07-20T15:01:09.787126+0000 mgr.y (mgr.14142) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:14.252 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[108361]: cluster 2023-07-20T15:01:11.787478+0000 mgr.y (mgr.14142) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:14.252 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[108361]: cluster 2023-07-20T15:01:13.689271+0000 mon.a (mon.0) 146 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-20T15:01:14.253 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[108361]: cluster 2023-07-20T15:01:13.691992+0000 mon.a (mon.0) 147 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],b=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0],c=[v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0]} 2023-07-20T15:01:14.253 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[108361]: cluster 2023-07-20T15:01:13.692034+0000 mon.a (mon.0) 148 : cluster [DBG] fsmap 2023-07-20T15:01:14.253 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[104935]: cluster 2023-07-20T15:01:13.692061+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2023-07-20T15:01:14.254 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[104935]: cluster 2023-07-20T15:01:13.692273+0000 mon.a (mon.0) 150 : cluster [DBG] mgrmap e13: y(active, since 58s) 2023-07-20T15:01:14.254 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[104935]: cluster 2023-07-20T15:01:13.692447+0000 mon.a (mon.0) 151 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-07-20T15:01:14.254 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[104935]: audit 2023-07-20T15:01:13.692844+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:09.047881\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}}, \"last_daemon_update\": \"2023-07-20T15:01:09.048032\", \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:01:14.254 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[104935]: cluster 2023-07-20T15:01:13.695767+0000 mon.a (mon.0) 153 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum a,c 2023-07-20T15:01:14.254 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[104935]: audit 2023-07-20T15:01:13.697941+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:09.047881\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}}, \"last_daemon_update\": \"2023-07-20T15:01:09.048032\", \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:01:14.290 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[108361]: cluster 2023-07-20T15:01:13.692061+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2023-07-20T15:01:14.291 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[108361]: cluster 2023-07-20T15:01:13.692273+0000 mon.a (mon.0) 150 : cluster [DBG] mgrmap e13: y(active, since 58s) 2023-07-20T15:01:14.291 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[108361]: cluster 2023-07-20T15:01:13.692447+0000 mon.a (mon.0) 151 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-07-20T15:01:14.291 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[108361]: audit 2023-07-20T15:01:13.692844+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:09.047881\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}}, \"last_daemon_update\": \"2023-07-20T15:01:09.048032\", \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:01:14.291 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[108361]: cluster 2023-07-20T15:01:13.695767+0000 mon.a (mon.0) 153 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum a,c 2023-07-20T15:01:14.291 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:13 smithi029 bash[108361]: audit 2023-07-20T15:01:13.697941+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:09.047881\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}}, \"last_daemon_update\": \"2023-07-20T15:01:09.048032\", \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:01:14.834 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-07-20T15:01:14.861 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":3,"fsid":"021c9860-270e-11ee-9b34-001a4aab830c","modified":"2023-07-20T15:01:08.673262Z","created":"2023-07-20T14:59:39.669074Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3301","nonce":0},{"type":"v1","addr":"172.21.15.29:6790","nonce":0}]},"addr":"172.21.15.29:6790/0","public_addr":"172.21.15.29:6790/0","priority":0,"weight":0},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0}],"quorum":[0,1]} 2023-07-20T15:01:14.861 INFO:teuthology.orchestra.run.smithi178.stderr:dumped monmap epoch 3 2023-07-20T15:01:15.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:14 smithi029 bash[104935]: cluster 2023-07-20T15:01:13.787811+0000 mgr.y (mgr.14142) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:15.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:14 smithi029 bash[108361]: cluster 2023-07-20T15:01:13.787811+0000 mgr.y (mgr.14142) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:16.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:15 smithi178 bash[104918]: cluster 2023-07-20T15:01:13.787811+0000 mgr.y (mgr.14142) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:16.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:15 smithi178 bash[104918]: cluster 2023-07-20T15:01:10.674278+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2023-07-20T15:01:16.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:15 smithi178 bash[104918]: cluster 2023-07-20T15:01:15.676297+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2023-07-20T15:01:16.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:15 smithi178 bash[104918]: cluster 2023-07-20T15:01:15.676685+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2023-07-20T15:01:16.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:15 smithi178 bash[104918]: cluster 2023-07-20T15:01:15.676742+0000 mon.a (mon.0) 156 : cluster [INF] mon.a calling monitor election 2023-07-20T15:01:16.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:15 smithi178 bash[104918]: cluster 2023-07-20T15:01:15.690214+0000 mon.a (mon.0) 157 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-20T15:01:16.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:15 smithi178 bash[104918]: cluster 2023-07-20T15:01:15.693510+0000 mon.a (mon.0) 158 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],b=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0],c=[v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0]} 2023-07-20T15:01:16.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:15 smithi178 bash[104918]: cluster 2023-07-20T15:01:15.693554+0000 mon.a (mon.0) 159 : cluster [DBG] fsmap 2023-07-20T15:01:16.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:15 smithi178 bash[104918]: cluster 2023-07-20T15:01:15.693580+0000 mon.a (mon.0) 160 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2023-07-20T15:01:16.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:15 smithi178 bash[104918]: cluster 2023-07-20T15:01:15.693775+0000 mon.a (mon.0) 161 : cluster [DBG] mgrmap e13: y(active, since 60s) 2023-07-20T15:01:16.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:15 smithi178 bash[104918]: cluster 2023-07-20T15:01:15.693930+0000 mon.a (mon.0) 162 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-07-20T15:01:16.190 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:15 smithi178 bash[104918]: cluster 2023-07-20T15:01:15.693952+0000 mon.a (mon.0) 163 : cluster [INF] Cluster is now healthy 2023-07-20T15:01:16.190 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:15 smithi178 bash[104918]: cluster 2023-07-20T15:01:15.698151+0000 mon.a (mon.0) 164 : cluster [INF] overall HEALTH_OK 2023-07-20T15:01:16.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[104935]: cluster 2023-07-20T15:01:10.674278+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2023-07-20T15:01:16.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[104935]: cluster 2023-07-20T15:01:15.676297+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2023-07-20T15:01:16.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[104935]: cluster 2023-07-20T15:01:15.676685+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2023-07-20T15:01:16.212 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[104935]: cluster 2023-07-20T15:01:15.676742+0000 mon.a (mon.0) 156 : cluster [INF] mon.a calling monitor election 2023-07-20T15:01:16.212 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[104935]: cluster 2023-07-20T15:01:15.690214+0000 mon.a (mon.0) 157 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-20T15:01:16.218 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[104935]: cluster 2023-07-20T15:01:15.693510+0000 mon.a (mon.0) 158 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],b=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0],c=[v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0]} 2023-07-20T15:01:16.242 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[104935]: cluster 2023-07-20T15:01:15.693554+0000 mon.a (mon.0) 159 : cluster [DBG] fsmap 2023-07-20T15:01:16.242 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[104935]: cluster 2023-07-20T15:01:15.693580+0000 mon.a (mon.0) 160 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2023-07-20T15:01:16.242 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[104935]: cluster 2023-07-20T15:01:15.693775+0000 mon.a (mon.0) 161 : cluster [DBG] mgrmap e13: y(active, since 60s) 2023-07-20T15:01:16.242 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[104935]: cluster 2023-07-20T15:01:15.693930+0000 mon.a (mon.0) 162 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-07-20T15:01:16.242 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[104935]: cluster 2023-07-20T15:01:15.693952+0000 mon.a (mon.0) 163 : cluster [INF] Cluster is now healthy 2023-07-20T15:01:16.243 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[104935]: cluster 2023-07-20T15:01:15.698151+0000 mon.a (mon.0) 164 : cluster [INF] overall HEALTH_OK 2023-07-20T15:01:16.243 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[108361]: cluster 2023-07-20T15:01:10.674278+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2023-07-20T15:01:16.243 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[108361]: cluster 2023-07-20T15:01:15.676297+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2023-07-20T15:01:16.243 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[108361]: cluster 2023-07-20T15:01:15.676685+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2023-07-20T15:01:16.244 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[108361]: cluster 2023-07-20T15:01:15.676742+0000 mon.a (mon.0) 156 : cluster [INF] mon.a calling monitor election 2023-07-20T15:01:16.244 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[108361]: cluster 2023-07-20T15:01:15.690214+0000 mon.a (mon.0) 157 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-20T15:01:16.264 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[108361]: cluster 2023-07-20T15:01:15.693510+0000 mon.a (mon.0) 158 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],b=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0],c=[v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0]} 2023-07-20T15:01:16.265 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[108361]: cluster 2023-07-20T15:01:15.693554+0000 mon.a (mon.0) 159 : cluster [DBG] fsmap 2023-07-20T15:01:16.265 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[108361]: cluster 2023-07-20T15:01:15.693580+0000 mon.a (mon.0) 160 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2023-07-20T15:01:16.265 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[108361]: cluster 2023-07-20T15:01:15.693775+0000 mon.a (mon.0) 161 : cluster [DBG] mgrmap e13: y(active, since 60s) 2023-07-20T15:01:16.266 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[108361]: cluster 2023-07-20T15:01:15.693930+0000 mon.a (mon.0) 162 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-07-20T15:01:16.266 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[108361]: cluster 2023-07-20T15:01:15.693952+0000 mon.a (mon.0) 163 : cluster [INF] Cluster is now healthy 2023-07-20T15:01:16.266 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:15 smithi029 bash[108361]: cluster 2023-07-20T15:01:15.698151+0000 mon.a (mon.0) 164 : cluster [INF] overall HEALTH_OK 2023-07-20T15:01:17.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:16 smithi178 bash[104918]: cluster 2023-07-20T15:01:15.788118+0000 mgr.y (mgr.14142) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:17.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:16 smithi029 bash[104935]: cluster 2023-07-20T15:01:15.788118+0000 mgr.y (mgr.14142) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:17.197 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:16 smithi029 bash[108361]: cluster 2023-07-20T15:01:15.788118+0000 mgr.y (mgr.14142) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:17.486 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-07-20T15:01:17.486 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph config generate-minimal-conf 2023-07-20T15:01:18.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:17 smithi029 bash[104935]: cluster 2023-07-20T15:01:16.785342+0000 mon.a (mon.0) 165 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2023-07-20T15:01:18.121 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:17 smithi029 bash[108361]: cluster 2023-07-20T15:01:16.785342+0000 mon.a (mon.0) 165 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2023-07-20T15:01:18.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:17 smithi178 bash[104918]: cluster 2023-07-20T15:01:16.785342+0000 mon.a (mon.0) 165 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2023-07-20T15:01:18.726 INFO:teuthology.orchestra.run.smithi029.stdout:# minimal ceph.conf for 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T15:01:18.726 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2023-07-20T15:01:18.726 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T15:01:18.726 INFO:teuthology.orchestra.run.smithi029.stdout: mon_host = [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2023-07-20T15:01:19.033 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:18 smithi029 bash[104935]: cluster 2023-07-20T15:01:17.788450+0000 mgr.y (mgr.14142) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:19.033 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:18 smithi029 bash[104935]: audit 2023-07-20T15:01:18.679714+0000 mon.a (mon.0) 166 : audit [DBG] from='client.? 172.21.15.29:0/3765330132' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:19.085 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:18 smithi029 bash[108361]: cluster 2023-07-20T15:01:17.788450+0000 mgr.y (mgr.14142) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:19.085 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:18 smithi029 bash[108361]: audit 2023-07-20T15:01:18.679714+0000 mon.a (mon.0) 166 : audit [DBG] from='client.? 172.21.15.29:0/3765330132' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:19.131 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-07-20T15:01:19.132 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-07-20T15:01:19.132 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.conf 2023-07-20T15:01:19.187 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:18 smithi178 bash[104918]: cluster 2023-07-20T15:01:17.788450+0000 mgr.y (mgr.14142) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:19.188 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:18 smithi178 bash[104918]: audit 2023-07-20T15:01:18.679714+0000 mon.a (mon.0) 166 : audit [DBG] from='client.? 172.21.15.29:0/3765330132' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:19.280 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-07-20T15:01:19.280 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-20T15:01:19.357 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-07-20T15:01:19.358 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.conf 2023-07-20T15:01:19.463 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-07-20T15:01:19.464 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-20T15:01:20.193 INFO:tasks.cephadm:Adding mgr.y on smithi029 2023-07-20T15:01:20.201 INFO:tasks.cephadm:Adding mgr.x on smithi178 2023-07-20T15:01:20.204 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph orch apply mgr '2;smithi029=y;smithi178=x' 2023-07-20T15:01:21.105 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:20 smithi178 bash[104918]: cluster 2023-07-20T15:01:19.788758+0000 mgr.y (mgr.14142) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:21.282 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:20 smithi029 bash[104935]: cluster 2023-07-20T15:01:19.788758+0000 mgr.y (mgr.14142) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:21.282 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:20 smithi029 bash[108361]: cluster 2023-07-20T15:01:19.788758+0000 mgr.y (mgr.14142) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:22.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:21 smithi029 bash[104935]: cluster 2023-07-20T15:01:21.789171+0000 mgr.y (mgr.14142) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:22.197 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:21 smithi029 bash[108361]: cluster 2023-07-20T15:01:21.789171+0000 mgr.y (mgr.14142) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:22.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:21 smithi178 bash[104918]: cluster 2023-07-20T15:01:21.789171+0000 mgr.y (mgr.14142) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:23.987 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled mgr update... 2023-07-20T15:01:24.223 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:23 smithi029 bash[104935]: cluster 2023-07-20T15:01:23.789543+0000 mgr.y (mgr.14142) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:24.224 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:23 smithi178 bash[104918]: cluster 2023-07-20T15:01:23.789543+0000 mgr.y (mgr.14142) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:24.227 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:23 smithi029 bash[108361]: cluster 2023-07-20T15:01:23.789543+0000 mgr.y (mgr.14142) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:24.428 DEBUG:teuthology.orchestra.run.smithi178:mgr.x> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.x.service 2023-07-20T15:01:24.458 INFO:tasks.cephadm:Deploying OSDs... 2023-07-20T15:01:24.458 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-07-20T15:01:24.458 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/scratch_devs of=/dev/stdout 2023-07-20T15:01:24.514 INFO:journalctl@ceph.mgr.x.smithi178.stdout:-- Logs begin at Thu 2023-07-20 14:49:59 UTC. -- 2023-07-20T15:01:24.567 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-20T15:01:24.568 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_1 2023-07-20T15:01:24.649 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-20T15:01:24.649 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-20T15:01:24.649 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 373637 Links: 1 2023-07-20T15:01:24.649 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-20T15:01:24.650 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-07-20T15:01:24.650 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-07-20 15:00:58.337890451 +0000 2023-07-20T15:01:24.650 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-07-20 14:57:47.174908197 +0000 2023-07-20T15:01:24.650 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-07-20 14:57:47.174908197 +0000 2023-07-20T15:01:24.650 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-07-20T15:01:24.650 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-20T15:01:24.752 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-07-20T15:01:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-07-20T15:01:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000127439 s, 4.0 MB/s 2023-07-20T15:01:24.753 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-20T15:01:24.915 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_2 2023-07-20T15:01:24.971 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-20T15:01:24.971 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-20T15:01:24.972 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 373733 Links: 1 2023-07-20T15:01:24.972 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-20T15:01:25.047 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-07-20T15:01:25.047 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-07-20 15:00:58.337890451 +0000 2023-07-20T15:01:25.047 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-07-20 14:57:47.809897690 +0000 2023-07-20T15:01:25.047 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-07-20 14:57:47.809897690 +0000 2023-07-20T15:01:25.047 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-07-20T15:01:25.048 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-20T15:01:25.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[104935]: audit 2023-07-20T15:01:23.938855+0000 mgr.y (mgr.14142) 35 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi029=y;smithi178=x", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:01:25.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[104935]: cephadm 2023-07-20T15:01:23.939512+0000 mgr.y (mgr.14142) 36 : cephadm [INF] Saving service mgr spec with placement count:2 smithi029=y,smithi178=x 2023-07-20T15:01:25.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[104935]: audit 2023-07-20T15:01:23.939908+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2023-07-20T15:01:23.939528\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi178\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2023-07-20T15:01:25.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[104935]: audit 2023-07-20T15:01:23.943130+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2023-07-20T15:01:23.939528\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi178\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2023-07-20T15:01:25.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[104935]: audit 2023-07-20T15:01:23.944571+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:01:25.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[104935]: audit 2023-07-20T15:01:23.947629+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-20T15:01:25.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[104935]: audit 2023-07-20T15:01:23.948495+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:25.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[104935]: cephadm 2023-07-20T15:01:23.949156+0000 mgr.y (mgr.14142) 37 : cephadm [INF] Deploying daemon mgr.x on smithi178 2023-07-20T15:01:25.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[104935]: audit 2023-07-20T15:01:23.949617+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2023-07-20T15:01:25.127 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[108361]: audit 2023-07-20T15:01:23.938855+0000 mgr.y (mgr.14142) 35 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi029=y;smithi178=x", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:01:25.128 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[108361]: cephadm 2023-07-20T15:01:23.939512+0000 mgr.y (mgr.14142) 36 : cephadm [INF] Saving service mgr spec with placement count:2 smithi029=y,smithi178=x 2023-07-20T15:01:25.128 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[108361]: audit 2023-07-20T15:01:23.939908+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2023-07-20T15:01:23.939528\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi178\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2023-07-20T15:01:25.139 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[108361]: audit 2023-07-20T15:01:23.943130+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2023-07-20T15:01:23.939528\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi178\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2023-07-20T15:01:25.139 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[108361]: audit 2023-07-20T15:01:23.944571+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:01:25.139 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[108361]: audit 2023-07-20T15:01:23.947629+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-20T15:01:25.140 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[108361]: audit 2023-07-20T15:01:23.948495+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:25.140 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[108361]: cephadm 2023-07-20T15:01:23.949156+0000 mgr.y (mgr.14142) 37 : cephadm [INF] Deploying daemon mgr.x on smithi178 2023-07-20T15:01:25.140 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:24 smithi029 bash[108361]: audit 2023-07-20T15:01:23.949617+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2023-07-20T15:01:25.157 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-07-20T15:01:25.158 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-07-20T15:01:25.165 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000103785 s, 4.9 MB/s 2023-07-20T15:01:25.166 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-20T15:01:25.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:24 smithi178 bash[104918]: audit 2023-07-20T15:01:23.938855+0000 mgr.y (mgr.14142) 35 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi029=y;smithi178=x", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:01:25.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:24 smithi178 bash[104918]: cephadm 2023-07-20T15:01:23.939512+0000 mgr.y (mgr.14142) 36 : cephadm [INF] Saving service mgr spec with placement count:2 smithi029=y,smithi178=x 2023-07-20T15:01:25.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:24 smithi178 bash[104918]: audit 2023-07-20T15:01:23.939908+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2023-07-20T15:01:23.939528\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi178\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2023-07-20T15:01:25.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:24 smithi178 bash[104918]: audit 2023-07-20T15:01:23.943130+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2023-07-20T15:01:23.939528\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi178\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2023-07-20T15:01:25.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:24 smithi178 bash[104918]: audit 2023-07-20T15:01:23.944571+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:01:25.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:24 smithi178 bash[104918]: audit 2023-07-20T15:01:23.947629+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-20T15:01:25.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:24 smithi178 bash[104918]: audit 2023-07-20T15:01:23.948495+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:25.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:24 smithi178 bash[104918]: cephadm 2023-07-20T15:01:23.949156+0000 mgr.y (mgr.14142) 37 : cephadm [INF] Deploying daemon mgr.x on smithi178 2023-07-20T15:01:25.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:24 smithi178 bash[104918]: audit 2023-07-20T15:01:23.949617+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2023-07-20T15:01:25.267 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_3 2023-07-20T15:01:25.507 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:01:25 smithi178 podman[105660]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr.x" found: no such container 2023-07-20T15:01:25.508 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:01:25 smithi178 systemd[1]: Started Ceph mgr.x for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:01:25.576 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-20T15:01:25.576 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-20T15:01:25.577 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 382592 Links: 1 2023-07-20T15:01:25.577 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-20T15:01:25.680 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-07-20T15:01:25.681 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-07-20 15:00:58.337890451 +0000 2023-07-20T15:01:25.681 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-07-20 14:57:48.414887679 +0000 2023-07-20T15:01:25.681 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-07-20 14:57:48.414887679 +0000 2023-07-20T15:01:25.681 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-07-20T15:01:25.681 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-20T15:01:25.781 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-07-20T15:01:25.782 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-07-20T15:01:25.782 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000122391 s, 4.2 MB/s 2023-07-20T15:01:25.815 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-20T15:01:25.886 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_4 2023-07-20T15:01:25.956 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-20T15:01:25.957 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-20T15:01:25.957 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 382688 Links: 1 2023-07-20T15:01:25.957 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-20T15:01:25.959 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-07-20T15:01:25.959 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-07-20 15:00:58.337890451 +0000 2023-07-20T15:01:25.959 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-07-20 14:57:49.142875633 +0000 2023-07-20T15:01:25.960 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-07-20 14:57:49.142875633 +0000 2023-07-20T15:01:25.960 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-07-20T15:01:25.960 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-20T15:01:25.988 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:25 smithi178 bash[104918]: audit 2023-07-20T15:01:25.288107+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:09.047881\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}}, \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:01:25.990 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:25 smithi178 bash[104918]: audit 2023-07-20T15:01:25.291397+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:09.047881\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}}, \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:01:25.990 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:25 smithi178 bash[104918]: audit 2023-07-20T15:01:25.292167+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:25.990 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:25 smithi178 bash[104918]: cluster 2023-07-20T15:01:25.789818+0000 mgr.y (mgr.14142) 38 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:26.039 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:25 smithi029 bash[108361]: audit 2023-07-20T15:01:25.288107+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:09.047881\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}}, \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:01:26.039 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:25 smithi029 bash[104935]: audit 2023-07-20T15:01:25.288107+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:09.047881\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}}, \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:01:26.040 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:25 smithi029 bash[108361]: audit 2023-07-20T15:01:25.291397+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:09.047881\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}}, \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:01:26.040 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:25 smithi029 bash[108361]: audit 2023-07-20T15:01:25.292167+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:26.040 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:25 smithi029 bash[108361]: cluster 2023-07-20T15:01:25.789818+0000 mgr.y (mgr.14142) 38 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:26.077 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:25 smithi029 bash[104935]: audit 2023-07-20T15:01:25.291397+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:09.047881\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}}, \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:01:26.105 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:25 smithi029 bash[104935]: audit 2023-07-20T15:01:25.292167+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:26.105 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:25 smithi029 bash[104935]: cluster 2023-07-20T15:01:25.789818+0000 mgr.y (mgr.14142) 38 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:26.126 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-07-20T15:01:26.126 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-07-20T15:01:26.126 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000118315 s, 4.3 MB/s 2023-07-20T15:01:26.127 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-20T15:01:26.209 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-07-20T15:01:26.210 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2023-07-20T15:01:26.285 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-20T15:01:26.286 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2023-07-20T15:01:26.468 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-20T15:01:26.468 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-20T15:01:26.468 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 381154 Links: 1 2023-07-20T15:01:26.469 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-20T15:01:26.469 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-07-20T15:01:26.469 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-07-20 15:01:25.178196645 +0000 2023-07-20T15:01:26.469 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-07-20 14:57:30.272616388 +0000 2023-07-20T15:01:26.469 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-07-20 14:57:30.272616388 +0000 2023-07-20T15:01:26.469 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-07-20T15:01:26.470 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-20T15:01:26.643 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-07-20T15:01:26.644 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-07-20T15:01:26.644 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000187348 s, 2.7 MB/s 2023-07-20T15:01:26.644 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-20T15:01:26.742 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2023-07-20T15:01:26.887 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-20T15:01:26.888 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-20T15:01:26.888 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 381273 Links: 1 2023-07-20T15:01:26.888 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-20T15:01:26.888 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-07-20T15:01:26.888 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-07-20 15:01:25.178196645 +0000 2023-07-20T15:01:26.889 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-07-20 14:57:31.015603449 +0000 2023-07-20T15:01:26.889 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-07-20 14:57:31.015603449 +0000 2023-07-20T15:01:26.889 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-07-20T15:01:26.904 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-20T15:01:26.974 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-07-20T15:01:26.984 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-07-20T15:01:26.984 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 9.6052e-05 s, 5.3 MB/s 2023-07-20T15:01:26.985 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-20T15:01:27.060 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2023-07-20T15:01:27.122 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-20T15:01:27.122 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-20T15:01:27.122 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 386225 Links: 1 2023-07-20T15:01:27.123 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-20T15:01:27.123 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-07-20T15:01:27.123 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-07-20 15:01:25.178196645 +0000 2023-07-20T15:01:27.123 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-07-20 14:57:31.626592809 +0000 2023-07-20T15:01:27.123 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-07-20 14:57:31.626592809 +0000 2023-07-20T15:01:27.123 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-07-20T15:01:27.124 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-20T15:01:27.225 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[104935]: audit 2023-07-20T15:01:25.968366+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967555\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967654\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}}, \"last_daemon_update\": \"2023-07-20T15:01:25.967760\", \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:01:27.226 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[108361]: audit 2023-07-20T15:01:25.968366+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967555\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967654\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}}, \"last_daemon_update\": \"2023-07-20T15:01:25.967760\", \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:01:27.265 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[104935]: audit 2023-07-20T15:01:25.971587+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967555\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967654\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}}, \"last_daemon_update\": \"2023-07-20T15:01:25.967760\", \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:01:27.506 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[104935]: cephadm 2023-07-20T15:01:25.972948+0000 mgr.y (mgr.14142) 39 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2023-07-20T15:01:27.515 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[104935]: audit 2023-07-20T15:01:25.973201+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2023-07-20T15:01:27.515 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[104935]: audit 2023-07-20T15:01:25.974118+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:27.515 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[104935]: cephadm 2023-07-20T15:01:25.974807+0000 mgr.y (mgr.14142) 40 : cephadm [INF] Reconfiguring daemon mgr.y on smithi029 2023-07-20T15:01:27.515 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[104935]: audit 2023-07-20T15:01:25.975294+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2023-07-20T15:01:27.516 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:26 smithi178 bash[104918]: audit 2023-07-20T15:01:25.968366+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967555\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967654\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}}, \"last_daemon_update\": \"2023-07-20T15:01:25.967760\", \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:01:27.585 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:26 smithi178 bash[104918]: audit 2023-07-20T15:01:25.971587+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967555\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967654\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}}, \"last_daemon_update\": \"2023-07-20T15:01:25.967760\", \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:01:27.592 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:26 smithi178 bash[104918]: cephadm 2023-07-20T15:01:25.972948+0000 mgr.y (mgr.14142) 39 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2023-07-20T15:01:27.592 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:26 smithi178 bash[104918]: audit 2023-07-20T15:01:25.973201+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2023-07-20T15:01:27.593 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:26 smithi178 bash[104918]: audit 2023-07-20T15:01:25.974118+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:27.593 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:26 smithi178 bash[104918]: cephadm 2023-07-20T15:01:25.974807+0000 mgr.y (mgr.14142) 40 : cephadm [INF] Reconfiguring daemon mgr.y on smithi029 2023-07-20T15:01:27.593 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:26 smithi178 bash[104918]: audit 2023-07-20T15:01:25.975294+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2023-07-20T15:01:27.593 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:26 smithi178 bash[104918]: audit 2023-07-20T15:01:26.810675+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412802\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}}, \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:27.593 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:26 smithi178 bash[104918]: audit 2023-07-20T15:01:26.813058+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412802\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}}, \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:27.594 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:26 smithi178 bash[104918]: audit 2023-07-20T15:01:26.813721+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:27.594 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[108361]: audit 2023-07-20T15:01:25.971587+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967555\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967654\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}}, \"last_daemon_update\": \"2023-07-20T15:01:25.967760\", \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:01:27.595 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[108361]: cephadm 2023-07-20T15:01:25.972948+0000 mgr.y (mgr.14142) 39 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2023-07-20T15:01:27.595 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[108361]: audit 2023-07-20T15:01:25.973201+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2023-07-20T15:01:27.595 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[108361]: audit 2023-07-20T15:01:25.974118+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:27.595 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[108361]: cephadm 2023-07-20T15:01:25.974807+0000 mgr.y (mgr.14142) 40 : cephadm [INF] Reconfiguring daemon mgr.y on smithi029 2023-07-20T15:01:27.595 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[108361]: audit 2023-07-20T15:01:25.975294+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2023-07-20T15:01:27.595 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[108361]: audit 2023-07-20T15:01:26.810675+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412802\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}}, \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:27.671 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[104935]: audit 2023-07-20T15:01:26.810675+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412802\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}}, \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:27.671 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[104935]: audit 2023-07-20T15:01:26.813058+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412802\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}}, \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:27.671 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[104935]: audit 2023-07-20T15:01:26.813721+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:27.672 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[108361]: audit 2023-07-20T15:01:26.813058+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412802\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:00:59.412916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}}, \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:27.672 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:26 smithi029 bash[108361]: audit 2023-07-20T15:01:26.813721+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:27.753 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-07-20T15:01:27.753 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-07-20T15:01:27.753 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 9.6317e-05 s, 5.3 MB/s 2023-07-20T15:01:27.754 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-20T15:01:27.804 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2023-07-20T15:01:27.981 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-20T15:01:27.982 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-20T15:01:27.982 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 383521 Links: 1 2023-07-20T15:01:27.982 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-20T15:01:27.982 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-07-20T15:01:27.983 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-07-20 15:01:25.178196645 +0000 2023-07-20T15:01:27.983 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-07-20 14:57:32.443578582 +0000 2023-07-20T15:01:27.983 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-07-20 14:57:32.443578582 +0000 2023-07-20T15:01:27.983 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-07-20T15:01:27.984 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-20T15:01:28.139 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-07-20T15:01:28.170 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-07-20T15:01:28.172 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000107719 s, 4.8 MB/s 2023-07-20T15:01:28.190 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-20T15:01:28.281 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:27 smithi029 bash[104935]: audit 2023-07-20T15:01:27.483272+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482545\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482621\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482656\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}}, \"last_daemon_update\": \"2023-07-20T15:01:27.482729\", \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:28.282 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:27 smithi029 bash[104935]: audit 2023-07-20T15:01:27.485512+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482545\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482621\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482656\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}}, \"last_daemon_update\": \"2023-07-20T15:01:27.482729\", \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:28.282 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:27 smithi029 bash[104935]: cluster 2023-07-20T15:01:27.790193+0000 mgr.y (mgr.14142) 41 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:28.344 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:27 smithi029 bash[108361]: audit 2023-07-20T15:01:27.483272+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482545\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482621\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482656\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}}, \"last_daemon_update\": \"2023-07-20T15:01:27.482729\", \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:28.345 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:27 smithi029 bash[108361]: audit 2023-07-20T15:01:27.485512+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482545\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482621\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482656\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}}, \"last_daemon_update\": \"2023-07-20T15:01:27.482729\", \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:28.359 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:27 smithi029 bash[108361]: cluster 2023-07-20T15:01:27.790193+0000 mgr.y (mgr.14142) 41 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:28.384 INFO:tasks.cephadm:Deploying osd.0 on smithi029 with /dev/vg_nvme/lv_4... 2023-07-20T15:01:28.406 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-07-20T15:01:28.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:27 smithi178 bash[104918]: audit 2023-07-20T15:01:27.483272+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482545\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482621\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482656\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}}, \"last_daemon_update\": \"2023-07-20T15:01:27.482729\", \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:28.481 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:27 smithi178 bash[104918]: audit 2023-07-20T15:01:27.485512+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482545\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482621\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482656\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}}, \"last_daemon_update\": \"2023-07-20T15:01:27.482729\", \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:28.482 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:27 smithi178 bash[104918]: cluster 2023-07-20T15:01:27.790193+0000 mgr.y (mgr.14142) 41 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:29.685 INFO:teuthology.orchestra.run.smithi029.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-07-20T15:01:29.685 INFO:teuthology.orchestra.run.smithi029.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-07-20T15:01:29.685 INFO:teuthology.orchestra.run.smithi029.stderr: stderr: 10+0 records in 2023-07-20T15:01:29.685 INFO:teuthology.orchestra.run.smithi029.stderr:10+0 records out 2023-07-20T15:01:29.685 INFO:teuthology.orchestra.run.smithi029.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00830818 s, 1.3 GB/s 2023-07-20T15:01:29.686 INFO:teuthology.orchestra.run.smithi029.stderr:--> Zapping successful for: 2023-07-20T15:01:29.870 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:29 smithi029 bash[104935]: cluster 2023-07-20T15:01:29.287182+0000 mon.a (mon.0) 186 : cluster [DBG] Standby manager daemon x started 2023-07-20T15:01:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:29 smithi029 bash[104935]: audit 2023-07-20T15:01:29.288080+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.178:0/4187419946' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:01:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:29 smithi029 bash[104935]: audit 2023-07-20T15:01:29.289040+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.178:0/4187419946' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:01:29.871 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:29 smithi029 bash[108361]: cluster 2023-07-20T15:01:29.287182+0000 mon.a (mon.0) 186 : cluster [DBG] Standby manager daemon x started 2023-07-20T15:01:29.871 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:29 smithi029 bash[108361]: audit 2023-07-20T15:01:29.288080+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.178:0/4187419946' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:01:29.871 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:29 smithi029 bash[108361]: audit 2023-07-20T15:01:29.289040+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.178:0/4187419946' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:01:29.940 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:29 smithi178 bash[104918]: cluster 2023-07-20T15:01:29.287182+0000 mon.a (mon.0) 186 : cluster [DBG] Standby manager daemon x started 2023-07-20T15:01:29.941 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:29 smithi178 bash[104918]: audit 2023-07-20T15:01:29.288080+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.178:0/4187419946' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:01:29.941 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:29 smithi178 bash[104918]: audit 2023-07-20T15:01:29.289040+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.178:0/4187419946' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:01:30.080 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi029:vg_nvme/lv_4 2023-07-20T15:01:30.918 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:30 smithi178 bash[104918]: cluster 2023-07-20T15:01:29.493924+0000 mon.a (mon.0) 187 : cluster [DBG] mgrmap e14: y(active, since 73s), standbys: x 2023-07-20T15:01:30.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:30 smithi178 bash[104918]: audit 2023-07-20T15:01:29.494058+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-20T15:01:30.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:30 smithi178 bash[104918]: cluster 2023-07-20T15:01:29.790398+0000 mgr.y (mgr.14142) 42 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:30.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:30 smithi029 bash[104935]: cluster 2023-07-20T15:01:29.493924+0000 mon.a (mon.0) 187 : cluster [DBG] mgrmap e14: y(active, since 73s), standbys: x 2023-07-20T15:01:30.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:30 smithi029 bash[104935]: audit 2023-07-20T15:01:29.494058+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-20T15:01:30.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:30 smithi029 bash[104935]: cluster 2023-07-20T15:01:29.790398+0000 mgr.y (mgr.14142) 42 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:30.978 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:30 smithi029 bash[108361]: cluster 2023-07-20T15:01:29.493924+0000 mon.a (mon.0) 187 : cluster [DBG] mgrmap e14: y(active, since 73s), standbys: x 2023-07-20T15:01:30.978 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:30 smithi029 bash[108361]: audit 2023-07-20T15:01:29.494058+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-20T15:01:30.978 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:30 smithi029 bash[108361]: cluster 2023-07-20T15:01:29.790398+0000 mgr.y (mgr.14142) 42 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:31.948 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:31 smithi029 bash[108361]: audit 2023-07-20T15:01:31.297983+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:01:31.948 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:31 smithi029 bash[108361]: audit 2023-07-20T15:01:31.298628+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:31.948 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:31 smithi029 bash[108361]: audit 2023-07-20T15:01:31.299363+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:31.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:31 smithi029 bash[104935]: audit 2023-07-20T15:01:31.297983+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:01:31.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:31 smithi029 bash[104935]: audit 2023-07-20T15:01:31.298628+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:31.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:31 smithi029 bash[104935]: audit 2023-07-20T15:01:31.299363+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:32.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:31 smithi178 bash[104918]: audit 2023-07-20T15:01:31.297983+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:01:32.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:31 smithi178 bash[104918]: audit 2023-07-20T15:01:31.298628+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:32.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:31 smithi178 bash[104918]: audit 2023-07-20T15:01:31.299363+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:33.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:32 smithi178 bash[104918]: audit 2023-07-20T15:01:31.296924+0000 mgr.y (mgr.14142) 43 : audit [DBG] from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:01:33.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:32 smithi178 bash[104918]: cephadm 2023-07-20T15:01:31.297704+0000 mgr.y (mgr.14142) 44 : cephadm [INF] Applying osd on host smithi029... 2023-07-20T15:01:33.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:32 smithi178 bash[104918]: cluster 2023-07-20T15:01:31.790646+0000 mgr.y (mgr.14142) 45 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:33.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:32 smithi029 bash[104935]: audit 2023-07-20T15:01:31.296924+0000 mgr.y (mgr.14142) 43 : audit [DBG] from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:01:33.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:32 smithi029 bash[104935]: cephadm 2023-07-20T15:01:31.297704+0000 mgr.y (mgr.14142) 44 : cephadm [INF] Applying osd on host smithi029... 2023-07-20T15:01:33.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:32 smithi029 bash[104935]: cluster 2023-07-20T15:01:31.790646+0000 mgr.y (mgr.14142) 45 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:33.199 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:32 smithi029 bash[108361]: audit 2023-07-20T15:01:31.296924+0000 mgr.y (mgr.14142) 43 : audit [DBG] from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:01:33.199 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:32 smithi029 bash[108361]: cephadm 2023-07-20T15:01:31.297704+0000 mgr.y (mgr.14142) 44 : cephadm [INF] Applying osd on host smithi029... 2023-07-20T15:01:33.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:32 smithi029 bash[108361]: cluster 2023-07-20T15:01:31.790646+0000 mgr.y (mgr.14142) 45 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:34.176 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:33 smithi178 bash[104918]: audit 2023-07-20T15:01:32.889375+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.29:0/28640776' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8465b78-5108-4a6c-8741-1aacec147eb7"}]: dispatch 2023-07-20T15:01:34.176 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:33 smithi178 bash[104918]: audit 2023-07-20T15:01:32.889645+0000 mon.a (mon.0) 192 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8465b78-5108-4a6c-8741-1aacec147eb7"}]: dispatch 2023-07-20T15:01:34.177 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:33 smithi178 bash[104918]: audit 2023-07-20T15:01:32.892874+0000 mon.a (mon.0) 193 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8465b78-5108-4a6c-8741-1aacec147eb7"}]': finished 2023-07-20T15:01:34.177 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:33 smithi178 bash[104918]: cluster 2023-07-20T15:01:32.892906+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2023-07-20T15:01:34.177 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:33 smithi178 bash[104918]: audit 2023-07-20T15:01:32.893000+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:01:34.177 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:33 smithi178 bash[104918]: audit 2023-07-20T15:01:33.623939+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.29:0/3885556770' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:01:34.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:33 smithi029 bash[104935]: audit 2023-07-20T15:01:32.889375+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.29:0/28640776' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8465b78-5108-4a6c-8741-1aacec147eb7"}]: dispatch 2023-07-20T15:01:34.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:33 smithi029 bash[104935]: audit 2023-07-20T15:01:32.889645+0000 mon.a (mon.0) 192 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8465b78-5108-4a6c-8741-1aacec147eb7"}]: dispatch 2023-07-20T15:01:34.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:33 smithi029 bash[104935]: audit 2023-07-20T15:01:32.892874+0000 mon.a (mon.0) 193 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8465b78-5108-4a6c-8741-1aacec147eb7"}]': finished 2023-07-20T15:01:34.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:33 smithi029 bash[104935]: cluster 2023-07-20T15:01:32.892906+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2023-07-20T15:01:34.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:33 smithi029 bash[104935]: audit 2023-07-20T15:01:32.893000+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:01:34.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:33 smithi029 bash[104935]: audit 2023-07-20T15:01:33.623939+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.29:0/3885556770' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:01:34.220 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:33 smithi029 bash[108361]: audit 2023-07-20T15:01:32.889375+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.29:0/28640776' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8465b78-5108-4a6c-8741-1aacec147eb7"}]: dispatch 2023-07-20T15:01:34.220 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:33 smithi029 bash[108361]: audit 2023-07-20T15:01:32.889645+0000 mon.a (mon.0) 192 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8465b78-5108-4a6c-8741-1aacec147eb7"}]: dispatch 2023-07-20T15:01:34.220 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:33 smithi029 bash[108361]: audit 2023-07-20T15:01:32.892874+0000 mon.a (mon.0) 193 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8465b78-5108-4a6c-8741-1aacec147eb7"}]': finished 2023-07-20T15:01:34.220 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:33 smithi029 bash[108361]: cluster 2023-07-20T15:01:32.892906+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2023-07-20T15:01:34.220 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:33 smithi029 bash[108361]: audit 2023-07-20T15:01:32.893000+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:01:34.220 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:33 smithi029 bash[108361]: audit 2023-07-20T15:01:33.623939+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.29:0/3885556770' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:01:35.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:34 smithi178 bash[104918]: cluster 2023-07-20T15:01:33.791146+0000 mgr.y (mgr.14142) 46 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:35.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:34 smithi029 bash[104935]: cluster 2023-07-20T15:01:33.791146+0000 mgr.y (mgr.14142) 46 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:35.197 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:34 smithi029 bash[108361]: cluster 2023-07-20T15:01:33.791146+0000 mgr.y (mgr.14142) 46 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:36.948 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:36 smithi029 bash[104935]: cluster 2023-07-20T15:01:35.791531+0000 mgr.y (mgr.14142) 47 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:36.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:36 smithi029 bash[104935]: audit 2023-07-20T15:01:35.868043+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:36.949 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:36 smithi029 bash[108361]: cluster 2023-07-20T15:01:35.791531+0000 mgr.y (mgr.14142) 47 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:36.949 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:36 smithi029 bash[108361]: audit 2023-07-20T15:01:35.868043+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:37.166 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:36 smithi178 bash[104918]: cluster 2023-07-20T15:01:35.791531+0000 mgr.y (mgr.14142) 47 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:37.176 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:36 smithi178 bash[104918]: audit 2023-07-20T15:01:35.868043+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:38.200 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:37 smithi178 bash[104918]: audit 2023-07-20T15:01:37.436359+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-20T15:01:38.200 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:37 smithi178 bash[104918]: audit 2023-07-20T15:01:37.436965+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:38.200 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:37 smithi178 bash[104918]: audit 2023-07-20T15:01:37.437683+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2023-07-20T15:01:38.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:37 smithi029 bash[104935]: audit 2023-07-20T15:01:37.436359+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-20T15:01:38.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:37 smithi029 bash[104935]: audit 2023-07-20T15:01:37.436965+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:38.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:37 smithi029 bash[104935]: audit 2023-07-20T15:01:37.437683+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2023-07-20T15:01:38.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:37 smithi029 bash[108361]: audit 2023-07-20T15:01:37.436359+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-20T15:01:38.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:37 smithi029 bash[108361]: audit 2023-07-20T15:01:37.436965+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:38.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:37 smithi029 bash[108361]: audit 2023-07-20T15:01:37.437683+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2023-07-20T15:01:38.636 INFO:teuthology.orchestra.run.smithi029.stdout:Created osd(s) 0 on host 'smithi029' 2023-07-20T15:01:39.100 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:38 smithi029 bash[108361]: cephadm 2023-07-20T15:01:37.437431+0000 mgr.y (mgr.14142) 48 : cephadm [INF] Deploying daemon osd.0 on smithi029 2023-07-20T15:01:39.100 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:38 smithi029 bash[108361]: cluster 2023-07-20T15:01:37.791859+0000 mgr.y (mgr.14142) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:39.101 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:38 smithi029 bash[104935]: cephadm 2023-07-20T15:01:37.437431+0000 mgr.y (mgr.14142) 48 : cephadm [INF] Deploying daemon osd.0 on smithi029 2023-07-20T15:01:39.101 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:38 smithi029 bash[104935]: cluster 2023-07-20T15:01:37.791859+0000 mgr.y (mgr.14142) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:39.101 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:38 smithi029 bash[104935]: audit 2023-07-20T15:01:38.583477+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482545\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482621\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482656\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:39.102 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:38 smithi029 bash[104935]: audit 2023-07-20T15:01:38.584012+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:39.102 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:38 smithi029 bash[104935]: audit 2023-07-20T15:01:38.587041+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482545\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482621\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482656\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:39.142 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:38 smithi029 bash[108361]: audit 2023-07-20T15:01:38.583477+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482545\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482621\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482656\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:39.142 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:38 smithi029 bash[108361]: audit 2023-07-20T15:01:38.584012+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:39.143 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:38 smithi029 bash[108361]: audit 2023-07-20T15:01:38.587041+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482545\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482621\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482656\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:39.144 DEBUG:teuthology.orchestra.run.smithi029:osd.0> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.0.service 2023-07-20T15:01:39.166 INFO:tasks.cephadm:Deploying osd.1 on smithi029 with /dev/vg_nvme/lv_3... 2023-07-20T15:01:39.167 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-07-20T15:01:39.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:38 smithi178 bash[104918]: cephadm 2023-07-20T15:01:37.437431+0000 mgr.y (mgr.14142) 48 : cephadm [INF] Deploying daemon osd.0 on smithi029 2023-07-20T15:01:39.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:38 smithi178 bash[104918]: cluster 2023-07-20T15:01:37.791859+0000 mgr.y (mgr.14142) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:39.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:38 smithi178 bash[104918]: audit 2023-07-20T15:01:38.583477+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482545\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482621\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482656\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:39.180 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:38 smithi178 bash[104918]: audit 2023-07-20T15:01:38.584012+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:39.180 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:38 smithi178 bash[104918]: audit 2023-07-20T15:01:38.587041+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482545\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482621\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:27.482656\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_device_update\": \"2023-07-20T15:00:22.515601\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:39.188 INFO:journalctl@ceph.osd.0.smithi029.stdout:-- Logs begin at Thu 2023-07-20 14:49:36 UTC. -- 2023-07-20T15:01:40.697 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:40 smithi029 bash[110693]: debug 2023-07-20T15:01:40.346+0000 7f53defadec0 -1 Falling back to public interface 2023-07-20T15:01:41.052 INFO:teuthology.orchestra.run.smithi029.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-07-20T15:01:41.053 INFO:teuthology.orchestra.run.smithi029.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-07-20T15:01:41.053 INFO:teuthology.orchestra.run.smithi029.stderr: stderr: 10+0 records in 2023-07-20T15:01:41.053 INFO:teuthology.orchestra.run.smithi029.stderr:10+0 records out 2023-07-20T15:01:41.053 INFO:teuthology.orchestra.run.smithi029.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012084 s, 868 MB/s 2023-07-20T15:01:41.053 INFO:teuthology.orchestra.run.smithi029.stderr:--> Zapping successful for: 2023-07-20T15:01:41.054 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:40 smithi029 bash[110693]: debug 2023-07-20T15:01:40.915+0000 7f53defadec0 -1 osd.0 0 log_to_monitors {default=true} 2023-07-20T15:01:41.055 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:40 smithi029 bash[104935]: cluster 2023-07-20T15:01:39.792126+0000 mgr.y (mgr.14142) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:41.055 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:40 smithi029 bash[104935]: audit 2023-07-20T15:01:39.874542+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"b73f21d756ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873884\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:39.630169\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_daemon_update\": \"2023-07-20T15:01:39.873956\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:41.055 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:40 smithi029 bash[104935]: audit 2023-07-20T15:01:39.877286+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"b73f21d756ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873884\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:39.630169\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_daemon_update\": \"2023-07-20T15:01:39.873956\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:41.055 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:40 smithi029 bash[104935]: audit 2023-07-20T15:01:39.877810+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:41.055 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:40 smithi029 bash[108361]: cluster 2023-07-20T15:01:39.792126+0000 mgr.y (mgr.14142) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:41.056 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:40 smithi029 bash[108361]: audit 2023-07-20T15:01:39.874542+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"b73f21d756ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873884\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:39.630169\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_daemon_update\": \"2023-07-20T15:01:39.873956\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:41.056 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:40 smithi029 bash[108361]: audit 2023-07-20T15:01:39.877286+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"b73f21d756ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873884\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:39.630169\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_daemon_update\": \"2023-07-20T15:01:39.873956\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:41.084 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:40 smithi029 bash[108361]: audit 2023-07-20T15:01:39.877810+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:41.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:40 smithi178 bash[104918]: cluster 2023-07-20T15:01:39.792126+0000 mgr.y (mgr.14142) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:41.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:40 smithi178 bash[104918]: audit 2023-07-20T15:01:39.874542+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"b73f21d756ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873884\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:39.630169\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_daemon_update\": \"2023-07-20T15:01:39.873956\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:41.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:40 smithi178 bash[104918]: audit 2023-07-20T15:01:39.877286+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"b73f21d756ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873884\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:39.630169\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_daemon_update\": \"2023-07-20T15:01:39.873956\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:41.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:40 smithi178 bash[104918]: audit 2023-07-20T15:01:39.877810+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:41.433 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi029:vg_nvme/lv_3 2023-07-20T15:01:41.947 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:41 smithi029 bash[104935]: audit 2023-07-20T15:01:40.919008+0000 mon.a (mon.0) 206 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/533923668,v1:172.21.15.29:6803/533923668]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-20T15:01:41.948 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:41 smithi029 bash[108361]: audit 2023-07-20T15:01:40.919008+0000 mon.a (mon.0) 206 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/533923668,v1:172.21.15.29:6803/533923668]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-20T15:01:42.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:41 smithi178 bash[104918]: audit 2023-07-20T15:01:40.919008+0000 mon.a (mon.0) 206 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/533923668,v1:172.21.15.29:6803/533923668]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-20T15:01:43.125 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[110693]: debug 2023-07-20T15:01:42.806+0000 7f53c3d5a700 -1 osd.0 0 waiting for initial osdmap 2023-07-20T15:01:43.125 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[110693]: debug 2023-07-20T15:01:42.810+0000 7f53cef76700 -1 osd.0 9 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2023-07-20T15:01:43.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[104935]: cluster 2023-07-20T15:01:41.792411+0000 mgr.y (mgr.14142) 51 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:43.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[104935]: audit 2023-07-20T15:01:41.800635+0000 mon.a (mon.0) 207 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/533923668,v1:172.21.15.29:6803/533923668]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-07-20T15:01:43.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[104935]: cluster 2023-07-20T15:01:41.800665+0000 mon.a (mon.0) 208 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2023-07-20T15:01:43.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[104935]: audit 2023-07-20T15:01:41.800773+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:01:43.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[104935]: audit 2023-07-20T15:01:41.801157+0000 mon.a (mon.0) 210 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/533923668,v1:172.21.15.29:6803/533923668]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:01:43.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[104935]: cluster 2023-07-20T15:01:41.900721+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:01:43.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[104935]: cluster 2023-07-20T15:01:41.900780+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:01:43.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[104935]: audit 2023-07-20T15:01:42.355779+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:43.127 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[108361]: cluster 2023-07-20T15:01:41.792411+0000 mgr.y (mgr.14142) 51 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:43.127 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[108361]: audit 2023-07-20T15:01:41.800635+0000 mon.a (mon.0) 207 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/533923668,v1:172.21.15.29:6803/533923668]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-07-20T15:01:43.128 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[108361]: cluster 2023-07-20T15:01:41.800665+0000 mon.a (mon.0) 208 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2023-07-20T15:01:43.128 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[108361]: audit 2023-07-20T15:01:41.800773+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:01:43.139 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[108361]: audit 2023-07-20T15:01:41.801157+0000 mon.a (mon.0) 210 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/533923668,v1:172.21.15.29:6803/533923668]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:01:43.139 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[108361]: cluster 2023-07-20T15:01:41.900721+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:01:43.139 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[108361]: cluster 2023-07-20T15:01:41.900780+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:01:43.140 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[108361]: audit 2023-07-20T15:01:42.355779+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:43.140 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[108361]: audit 2023-07-20T15:01:42.583656+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"b73f21d756ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873884\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:39.630169\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_daemon_update\": \"2023-07-20T15:01:39.873956\", \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:43.140 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[104935]: audit 2023-07-20T15:01:42.583656+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"b73f21d756ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873884\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:39.630169\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_daemon_update\": \"2023-07-20T15:01:39.873956\", \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:43.141 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[108361]: audit 2023-07-20T15:01:42.587212+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"b73f21d756ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873884\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:39.630169\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_daemon_update\": \"2023-07-20T15:01:39.873956\", \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:43.141 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[108361]: audit 2023-07-20T15:01:42.781648+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:01:43.141 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[108361]: audit 2023-07-20T15:01:42.782214+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:43.141 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[108361]: audit 2023-07-20T15:01:42.782888+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:43.142 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[104935]: audit 2023-07-20T15:01:42.587212+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"b73f21d756ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873884\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:39.630169\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_daemon_update\": \"2023-07-20T15:01:39.873956\", \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:43.142 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[104935]: audit 2023-07-20T15:01:42.781648+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:01:43.142 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[104935]: audit 2023-07-20T15:01:42.782214+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:43.142 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:42 smithi029 bash[104935]: audit 2023-07-20T15:01:42.782888+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:43.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:42 smithi178 bash[104918]: cluster 2023-07-20T15:01:41.792411+0000 mgr.y (mgr.14142) 51 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:43.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:42 smithi178 bash[104918]: audit 2023-07-20T15:01:41.800635+0000 mon.a (mon.0) 207 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/533923668,v1:172.21.15.29:6803/533923668]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-07-20T15:01:43.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:42 smithi178 bash[104918]: cluster 2023-07-20T15:01:41.800665+0000 mon.a (mon.0) 208 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2023-07-20T15:01:43.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:42 smithi178 bash[104918]: audit 2023-07-20T15:01:41.800773+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:01:43.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:42 smithi178 bash[104918]: audit 2023-07-20T15:01:41.801157+0000 mon.a (mon.0) 210 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/533923668,v1:172.21.15.29:6803/533923668]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:01:43.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:42 smithi178 bash[104918]: cluster 2023-07-20T15:01:41.900721+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:01:43.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:42 smithi178 bash[104918]: cluster 2023-07-20T15:01:41.900780+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:01:43.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:42 smithi178 bash[104918]: audit 2023-07-20T15:01:42.355779+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:43.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:42 smithi178 bash[104918]: audit 2023-07-20T15:01:42.583656+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"b73f21d756ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873884\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:39.630169\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_daemon_update\": \"2023-07-20T15:01:39.873956\", \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:43.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:42 smithi178 bash[104918]: audit 2023-07-20T15:01:42.587212+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"b73f21d756ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873884\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:39.630169\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:37.436041\"}}, \"last_daemon_update\": \"2023-07-20T15:01:39.873956\", \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:43.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:42 smithi178 bash[104918]: audit 2023-07-20T15:01:42.781648+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:01:43.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:42 smithi178 bash[104918]: audit 2023-07-20T15:01:42.782214+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:43.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:42 smithi178 bash[104918]: audit 2023-07-20T15:01:42.782888+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:43.947 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:43 smithi029 bash[104935]: audit 2023-07-20T15:01:42.780783+0000 mgr.y (mgr.14142) 52 : audit [DBG] from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:01:43.948 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:43 smithi029 bash[104935]: cephadm 2023-07-20T15:01:42.781390+0000 mgr.y (mgr.14142) 53 : cephadm [INF] Applying osd on host smithi029... 2023-07-20T15:01:43.948 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:43 smithi029 bash[104935]: audit 2023-07-20T15:01:42.802206+0000 mon.a (mon.0) 217 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/533923668,v1:172.21.15.29:6803/533923668]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-07-20T15:01:43.948 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:43 smithi029 bash[104935]: cluster 2023-07-20T15:01:42.802256+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2023-07-20T15:01:43.948 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:43 smithi029 bash[104935]: audit 2023-07-20T15:01:42.802770+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:01:43.949 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:43 smithi029 bash[108361]: audit 2023-07-20T15:01:42.780783+0000 mgr.y (mgr.14142) 52 : audit [DBG] from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:01:43.949 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:43 smithi029 bash[108361]: cephadm 2023-07-20T15:01:42.781390+0000 mgr.y (mgr.14142) 53 : cephadm [INF] Applying osd on host smithi029... 2023-07-20T15:01:43.949 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:43 smithi029 bash[108361]: audit 2023-07-20T15:01:42.802206+0000 mon.a (mon.0) 217 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/533923668,v1:172.21.15.29:6803/533923668]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-07-20T15:01:43.949 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:43 smithi029 bash[108361]: cluster 2023-07-20T15:01:42.802256+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2023-07-20T15:01:43.949 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:43 smithi029 bash[108361]: audit 2023-07-20T15:01:42.802770+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:01:44.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:43 smithi178 bash[104918]: audit 2023-07-20T15:01:42.780783+0000 mgr.y (mgr.14142) 52 : audit [DBG] from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:01:44.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:43 smithi178 bash[104918]: cephadm 2023-07-20T15:01:42.781390+0000 mgr.y (mgr.14142) 53 : cephadm [INF] Applying osd on host smithi029... 2023-07-20T15:01:44.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:43 smithi178 bash[104918]: audit 2023-07-20T15:01:42.802206+0000 mon.a (mon.0) 217 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/533923668,v1:172.21.15.29:6803/533923668]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-07-20T15:01:44.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:43 smithi178 bash[104918]: cluster 2023-07-20T15:01:42.802256+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2023-07-20T15:01:44.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:43 smithi178 bash[104918]: audit 2023-07-20T15:01:42.802770+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:01:45.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:44 smithi178 bash[104918]: cluster 2023-07-20T15:01:43.792695+0000 mgr.y (mgr.14142) 54 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:45.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:44 smithi178 bash[104918]: cluster 2023-07-20T15:01:43.808420+0000 mon.a (mon.0) 220 : cluster [INF] osd.0 [v2:172.21.15.29:6802/533923668,v1:172.21.15.29:6803/533923668] boot 2023-07-20T15:01:45.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:44 smithi178 bash[104918]: cluster 2023-07-20T15:01:43.808450+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2023-07-20T15:01:45.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:44 smithi178 bash[104918]: audit 2023-07-20T15:01:43.808973+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:01:45.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:44 smithi178 bash[104918]: audit 2023-07-20T15:01:44.482389+0000 mon.c (mon.1) 6 : audit [INF] from='client.? 172.21.15.29:0/1562675836' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f51402c-d77b-420c-801b-5b204f09a8cf"}]: dispatch 2023-07-20T15:01:45.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:44 smithi178 bash[104918]: audit 2023-07-20T15:01:44.482699+0000 mon.a (mon.0) 223 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f51402c-d77b-420c-801b-5b204f09a8cf"}]: dispatch 2023-07-20T15:01:45.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:44 smithi178 bash[104918]: audit 2023-07-20T15:01:44.486397+0000 mon.a (mon.0) 224 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f51402c-d77b-420c-801b-5b204f09a8cf"}]': finished 2023-07-20T15:01:45.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:44 smithi178 bash[104918]: cluster 2023-07-20T15:01:44.486449+0000 mon.a (mon.0) 225 : cluster [DBG] osdmap e11: 2 total, 1 up, 1 in 2023-07-20T15:01:45.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:44 smithi178 bash[104918]: audit 2023-07-20T15:01:44.486555+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:45.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[104935]: cluster 2023-07-20T15:01:43.792695+0000 mgr.y (mgr.14142) 54 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:45.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[104935]: cluster 2023-07-20T15:01:43.808420+0000 mon.a (mon.0) 220 : cluster [INF] osd.0 [v2:172.21.15.29:6802/533923668,v1:172.21.15.29:6803/533923668] boot 2023-07-20T15:01:45.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[104935]: cluster 2023-07-20T15:01:43.808450+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2023-07-20T15:01:45.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[104935]: audit 2023-07-20T15:01:43.808973+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:01:45.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[104935]: audit 2023-07-20T15:01:44.482389+0000 mon.c (mon.1) 6 : audit [INF] from='client.? 172.21.15.29:0/1562675836' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f51402c-d77b-420c-801b-5b204f09a8cf"}]: dispatch 2023-07-20T15:01:45.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[104935]: audit 2023-07-20T15:01:44.482699+0000 mon.a (mon.0) 223 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f51402c-d77b-420c-801b-5b204f09a8cf"}]: dispatch 2023-07-20T15:01:45.252 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[104935]: audit 2023-07-20T15:01:44.486397+0000 mon.a (mon.0) 224 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f51402c-d77b-420c-801b-5b204f09a8cf"}]': finished 2023-07-20T15:01:45.253 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[104935]: cluster 2023-07-20T15:01:44.486449+0000 mon.a (mon.0) 225 : cluster [DBG] osdmap e11: 2 total, 1 up, 1 in 2023-07-20T15:01:45.253 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[104935]: audit 2023-07-20T15:01:44.486555+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:45.253 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[108361]: cluster 2023-07-20T15:01:43.792695+0000 mgr.y (mgr.14142) 54 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-20T15:01:45.253 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[108361]: cluster 2023-07-20T15:01:43.808420+0000 mon.a (mon.0) 220 : cluster [INF] osd.0 [v2:172.21.15.29:6802/533923668,v1:172.21.15.29:6803/533923668] boot 2023-07-20T15:01:45.253 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[108361]: cluster 2023-07-20T15:01:43.808450+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2023-07-20T15:01:45.254 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[108361]: audit 2023-07-20T15:01:43.808973+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:01:45.254 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[108361]: audit 2023-07-20T15:01:44.482389+0000 mon.c (mon.1) 6 : audit [INF] from='client.? 172.21.15.29:0/1562675836' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f51402c-d77b-420c-801b-5b204f09a8cf"}]: dispatch 2023-07-20T15:01:45.254 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[108361]: audit 2023-07-20T15:01:44.482699+0000 mon.a (mon.0) 223 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f51402c-d77b-420c-801b-5b204f09a8cf"}]: dispatch 2023-07-20T15:01:45.254 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[108361]: audit 2023-07-20T15:01:44.486397+0000 mon.a (mon.0) 224 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f51402c-d77b-420c-801b-5b204f09a8cf"}]': finished 2023-07-20T15:01:45.254 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[108361]: cluster 2023-07-20T15:01:44.486449+0000 mon.a (mon.0) 225 : cluster [DBG] osdmap e11: 2 total, 1 up, 1 in 2023-07-20T15:01:45.254 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:44 smithi029 bash[108361]: audit 2023-07-20T15:01:44.486555+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:46.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:45 smithi178 bash[104918]: audit 2023-07-20T15:01:45.226382+0000 mon.c (mon.1) 7 : audit [DBG] from='client.? 172.21.15.29:0/3360878569' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:01:46.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:45 smithi178 bash[104918]: cluster 2023-07-20T15:01:45.488123+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e12: 2 total, 1 up, 1 in 2023-07-20T15:01:46.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:45 smithi178 bash[104918]: audit 2023-07-20T15:01:45.488229+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:46.208 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:45 smithi029 bash[104935]: audit 2023-07-20T15:01:45.226382+0000 mon.c (mon.1) 7 : audit [DBG] from='client.? 172.21.15.29:0/3360878569' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:01:46.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:45 smithi029 bash[104935]: cluster 2023-07-20T15:01:45.488123+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e12: 2 total, 1 up, 1 in 2023-07-20T15:01:46.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:45 smithi029 bash[104935]: audit 2023-07-20T15:01:45.488229+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:46.209 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:45 smithi029 bash[108361]: audit 2023-07-20T15:01:45.226382+0000 mon.c (mon.1) 7 : audit [DBG] from='client.? 172.21.15.29:0/3360878569' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:01:46.209 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:45 smithi029 bash[108361]: cluster 2023-07-20T15:01:45.488123+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e12: 2 total, 1 up, 1 in 2023-07-20T15:01:46.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:45 smithi029 bash[108361]: audit 2023-07-20T15:01:45.488229+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:47.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:46 smithi178 bash[104918]: cluster 2023-07-20T15:01:45.792992+0000 mgr.y (mgr.14142) 55 : cluster [DBG] pgmap v45: 1 pgs: 1 undersized+peered; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:47.176 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:46 smithi029 bash[104935]: cluster 2023-07-20T15:01:45.792992+0000 mgr.y (mgr.14142) 55 : cluster [DBG] pgmap v45: 1 pgs: 1 undersized+peered; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:47.177 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:46 smithi029 bash[108361]: cluster 2023-07-20T15:01:45.792992+0000 mgr.y (mgr.14142) 55 : cluster [DBG] pgmap v45: 1 pgs: 1 undersized+peered; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:48.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:47 smithi178 bash[104918]: audit 2023-07-20T15:01:47.473771+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:48.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:47 smithi029 bash[104935]: audit 2023-07-20T15:01:47.473771+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:48.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:47 smithi029 bash[108361]: audit 2023-07-20T15:01:47.473771+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:49.112 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:48 smithi029 bash[104935]: cluster 2023-07-20T15:01:47.793281+0000 mgr.y (mgr.14142) 56 : cluster [DBG] pgmap v46: 1 pgs: 1 undersized+peered; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:49.112 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:48 smithi029 bash[108361]: cluster 2023-07-20T15:01:47.793281+0000 mgr.y (mgr.14142) 56 : cluster [DBG] pgmap v46: 1 pgs: 1 undersized+peered; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:49.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:48 smithi178 bash[104918]: cluster 2023-07-20T15:01:47.793281+0000 mgr.y (mgr.14142) 56 : cluster [DBG] pgmap v46: 1 pgs: 1 undersized+peered; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:50.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:49 smithi178 bash[104918]: audit 2023-07-20T15:01:49.122112+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-20T15:01:50.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:49 smithi178 bash[104918]: audit 2023-07-20T15:01:49.122726+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:50.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:49 smithi178 bash[104918]: audit 2023-07-20T15:01:49.123372+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2023-07-20T15:01:50.172 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:49 smithi029 bash[108361]: audit 2023-07-20T15:01:49.122112+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-20T15:01:50.172 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:49 smithi029 bash[108361]: audit 2023-07-20T15:01:49.122726+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:50.172 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:49 smithi029 bash[108361]: audit 2023-07-20T15:01:49.123372+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2023-07-20T15:01:50.173 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:49 smithi029 bash[104935]: audit 2023-07-20T15:01:49.122112+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-20T15:01:50.174 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:49 smithi029 bash[104935]: audit 2023-07-20T15:01:49.122726+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:50.174 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:49 smithi029 bash[104935]: audit 2023-07-20T15:01:49.123372+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2023-07-20T15:01:50.174 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:50 smithi029 systemd[1]: Stopping Ceph osd.0 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:01:50.175 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:50 smithi029 bash[110693]: debug 2023-07-20T15:01:50.128+0000 7f53d67f5700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T15:01:50.175 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:50 smithi029 bash[110693]: debug 2023-07-20T15:01:50.128+0000 7f53d67f5700 -1 osd.0 12 *** Got signal Terminated *** 2023-07-20T15:01:50.175 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:50 smithi029 bash[110693]: debug 2023-07-20T15:01:50.128+0000 7f53d67f5700 -1 osd.0 12 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-20T15:01:50.698 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:50 smithi029 podman[111936]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.0 2023-07-20T15:01:51.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:50 smithi178 bash[104918]: cephadm 2023-07-20T15:01:49.123165+0000 mgr.y (mgr.14142) 57 : cephadm [INF] Deploying daemon osd.0 on smithi029 2023-07-20T15:01:51.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:50 smithi178 bash[104918]: cluster 2023-07-20T15:01:49.793516+0000 mgr.y (mgr.14142) 58 : cluster [DBG] pgmap v47: 1 pgs: 1 undersized+peered; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:51.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:50 smithi029 bash[104935]: cephadm 2023-07-20T15:01:49.123165+0000 mgr.y (mgr.14142) 57 : cephadm [INF] Deploying daemon osd.0 on smithi029 2023-07-20T15:01:51.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:50 smithi029 bash[104935]: cluster 2023-07-20T15:01:49.793516+0000 mgr.y (mgr.14142) 58 : cluster [DBG] pgmap v47: 1 pgs: 1 undersized+peered; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:51.197 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:50 smithi029 bash[108361]: cephadm 2023-07-20T15:01:49.123165+0000 mgr.y (mgr.14142) 57 : cephadm [INF] Deploying daemon osd.0 on smithi029 2023-07-20T15:01:51.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:50 smithi029 bash[108361]: cluster 2023-07-20T15:01:49.793516+0000 mgr.y (mgr.14142) 58 : cluster [DBG] pgmap v47: 1 pgs: 1 undersized+peered; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:51.565 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:51 smithi029 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.0.service: Succeeded. 2023-07-20T15:01:51.566 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:51 smithi029 systemd[1]: Stopped Ceph osd.0 for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:01:51.566 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:51 smithi029 systemd[1]: Starting Ceph osd.0 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:01:51.566 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:51 smithi029 podman[112072]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.0" found: no such container 2023-07-20T15:01:51.566 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:51 smithi029 systemd[1]: Started Ceph osd.0 for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:01:52.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:51 smithi178 bash[104918]: audit 2023-07-20T15:01:51.392226+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}}, \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:52.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:51 smithi178 bash[104918]: audit 2023-07-20T15:01:51.392922+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:52.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:51 smithi178 bash[104918]: audit 2023-07-20T15:01:51.395855+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}}, \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:52.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:51 smithi178 bash[104918]: audit 2023-07-20T15:01:51.398078+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-20T15:01:52.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:51 smithi178 bash[104918]: audit 2023-07-20T15:01:51.398780+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:52.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:51 smithi178 bash[104918]: audit 2023-07-20T15:01:51.399500+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2023-07-20T15:01:52.197 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[112089]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-20T15:01:52.198 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[112089]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2023-07-20T15:01:52.198 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[112089]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2023-07-20T15:01:52.198 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[112089]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2023-07-20T15:01:52.198 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[112089]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-07-20T15:01:52.204 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[112089]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-20T15:01:52.204 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[112089]: --> ceph-volume lvm activate successful for osd ID: 0 2023-07-20T15:01:52.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[104935]: audit 2023-07-20T15:01:51.392226+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}}, \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:52.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[104935]: audit 2023-07-20T15:01:51.392922+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:52.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[104935]: audit 2023-07-20T15:01:51.395855+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}}, \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:52.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[104935]: audit 2023-07-20T15:01:51.398078+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-20T15:01:52.207 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[104935]: audit 2023-07-20T15:01:51.398780+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:52.207 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[104935]: audit 2023-07-20T15:01:51.399500+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2023-07-20T15:01:52.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[108361]: audit 2023-07-20T15:01:51.392226+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}}, \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:52.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[108361]: audit 2023-07-20T15:01:51.392922+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:52.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[108361]: audit 2023-07-20T15:01:51.395855+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873741\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873818\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:39.873852\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}}, \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:52.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[108361]: audit 2023-07-20T15:01:51.398078+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-20T15:01:52.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[108361]: audit 2023-07-20T15:01:51.398780+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:52.209 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:51 smithi029 bash[108361]: audit 2023-07-20T15:01:51.399500+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2023-07-20T15:01:53.103 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:52 smithi029 bash[108361]: cephadm 2023-07-20T15:01:51.399274+0000 mgr.y (mgr.14142) 59 : cephadm [INF] Deploying daemon osd.1 on smithi029 2023-07-20T15:01:53.104 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:52 smithi029 bash[108361]: cluster 2023-07-20T15:01:51.793790+0000 mgr.y (mgr.14142) 60 : cluster [DBG] pgmap v48: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:53.104 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:52 smithi029 bash[104935]: cephadm 2023-07-20T15:01:51.399274+0000 mgr.y (mgr.14142) 59 : cephadm [INF] Deploying daemon osd.1 on smithi029 2023-07-20T15:01:53.105 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:52 smithi029 bash[104935]: cluster 2023-07-20T15:01:51.793790+0000 mgr.y (mgr.14142) 60 : cluster [DBG] pgmap v48: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:53.105 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:52 smithi029 bash[104935]: audit 2023-07-20T15:01:52.633338+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632361\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632438\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632472\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632503\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}}, \"last_daemon_update\": \"2023-07-20T15:01:52.632581\", \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:53.105 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:52 smithi029 bash[104935]: audit 2023-07-20T15:01:52.635832+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632361\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632438\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632472\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632503\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}}, \"last_daemon_update\": \"2023-07-20T15:01:52.632581\", \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:53.105 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:52 smithi029 bash[108361]: audit 2023-07-20T15:01:52.633338+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632361\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632438\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632472\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632503\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}}, \"last_daemon_update\": \"2023-07-20T15:01:52.632581\", \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:53.105 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:52 smithi029 bash[108361]: audit 2023-07-20T15:01:52.635832+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632361\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632438\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632472\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632503\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}}, \"last_daemon_update\": \"2023-07-20T15:01:52.632581\", \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:53.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:52 smithi178 bash[104918]: cephadm 2023-07-20T15:01:51.399274+0000 mgr.y (mgr.14142) 59 : cephadm [INF] Deploying daemon osd.1 on smithi029 2023-07-20T15:01:53.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:52 smithi178 bash[104918]: cluster 2023-07-20T15:01:51.793790+0000 mgr.y (mgr.14142) 60 : cluster [DBG] pgmap v48: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:53.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:52 smithi178 bash[104918]: audit 2023-07-20T15:01:52.633338+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632361\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632438\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632472\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632503\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}}, \"last_daemon_update\": \"2023-07-20T15:01:52.632581\", \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:53.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:52 smithi178 bash[104918]: audit 2023-07-20T15:01:52.635832+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632361\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632438\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632472\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632503\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}}, \"last_daemon_update\": \"2023-07-20T15:01:52.632581\", \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:53.181 INFO:teuthology.orchestra.run.smithi029.stdout:Created osd(s) 0,1 on host 'smithi029' 2023-07-20T15:01:53.360 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[112337]: debug 2023-07-20T15:01:53.124+0000 7fc6f985bec0 -1 Falling back to public interface 2023-07-20T15:01:53.885 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[104935]: audit 2023-07-20T15:01:53.127604+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632361\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632438\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632472\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632503\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:53.885 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[104935]: audit 2023-07-20T15:01:53.128033+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:53.885 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[104935]: audit 2023-07-20T15:01:53.131408+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632361\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632438\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632472\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632503\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:53.885 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[104935]: audit 2023-07-20T15:01:53.700382+0000 mon.c (mon.1) 8 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/1634899187,v1:172.21.15.29:6803/1634899187]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-20T15:01:53.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[104935]: audit 2023-07-20T15:01:53.700824+0000 mon.a (mon.0) 244 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-20T15:01:53.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[104935]: audit 2023-07-20T15:01:53.701675+0000 mon.c (mon.1) 9 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/1634899187,v1:172.21.15.29:6803/1634899187]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:01:53.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[104935]: audit 2023-07-20T15:01:53.702229+0000 mon.a (mon.0) 245 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:01:53.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[104935]: cluster 2023-07-20T15:01:53.794228+0000 mgr.y (mgr.14142) 61 : cluster [DBG] pgmap v49: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:53.887 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[108361]: audit 2023-07-20T15:01:53.127604+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632361\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632438\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632472\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632503\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:53.887 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[108361]: audit 2023-07-20T15:01:53.128033+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:53.887 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[108361]: audit 2023-07-20T15:01:53.131408+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632361\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632438\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632472\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632503\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:53.887 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[108361]: audit 2023-07-20T15:01:53.700382+0000 mon.c (mon.1) 8 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/1634899187,v1:172.21.15.29:6803/1634899187]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-20T15:01:53.887 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[108361]: audit 2023-07-20T15:01:53.700824+0000 mon.a (mon.0) 244 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-20T15:01:53.916 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[108361]: audit 2023-07-20T15:01:53.701675+0000 mon.c (mon.1) 9 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/1634899187,v1:172.21.15.29:6803/1634899187]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:01:53.916 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[108361]: audit 2023-07-20T15:01:53.702229+0000 mon.a (mon.0) 245 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:01:53.917 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[108361]: cluster 2023-07-20T15:01:53.794228+0000 mgr.y (mgr.14142) 61 : cluster [DBG] pgmap v49: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:53.917 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[112337]: debug 2023-07-20T15:01:53.695+0000 7fc6f985bec0 -1 osd.0 12 log_to_monitors {default=true} 2023-07-20T15:01:53.917 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:01:53 smithi029 bash[112337]: debug 2023-07-20T15:01:53.718+0000 7fc6ed82c700 -1 osd.0 12 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2023-07-20T15:01:53.918 DEBUG:teuthology.orchestra.run.smithi029:osd.1> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.1.service 2023-07-20T15:01:53.986 INFO:tasks.cephadm:Deploying osd.2 on smithi029 with /dev/vg_nvme/lv_2... 2023-07-20T15:01:53.987 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-07-20T15:01:54.011 INFO:journalctl@ceph.osd.1.smithi029.stdout:-- Logs begin at Thu 2023-07-20 14:49:36 UTC. -- 2023-07-20T15:01:54.274 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:53 smithi178 bash[104918]: audit 2023-07-20T15:01:53.127604+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632361\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632438\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632472\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632503\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:54.275 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:53 smithi178 bash[104918]: audit 2023-07-20T15:01:53.128033+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:54.275 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:53 smithi178 bash[104918]: audit 2023-07-20T15:01:53.131408+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632361\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632438\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632472\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:52.632503\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_device_update\": \"2023-07-20T15:01:42.583071\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:54.275 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:53 smithi178 bash[104918]: audit 2023-07-20T15:01:53.700382+0000 mon.c (mon.1) 8 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/1634899187,v1:172.21.15.29:6803/1634899187]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-20T15:01:54.275 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:53 smithi178 bash[104918]: audit 2023-07-20T15:01:53.700824+0000 mon.a (mon.0) 244 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-20T15:01:54.276 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:53 smithi178 bash[104918]: audit 2023-07-20T15:01:53.701675+0000 mon.c (mon.1) 9 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/1634899187,v1:172.21.15.29:6803/1634899187]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:01:54.288 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:53 smithi178 bash[104918]: audit 2023-07-20T15:01:53.702229+0000 mon.a (mon.0) 245 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:01:54.288 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:53 smithi178 bash[104918]: cluster 2023-07-20T15:01:53.794228+0000 mgr.y (mgr.14142) 61 : cluster [DBG] pgmap v49: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:55.137 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[112918]: debug 2023-07-20T15:01:55.056+0000 7f98b1094ec0 -1 Falling back to public interface 2023-07-20T15:01:55.137 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:54 smithi029 bash[104935]: cluster 2023-07-20T15:01:54.129360+0000 mon.a (mon.0) 246 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:01:55.137 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:54 smithi029 bash[104935]: cluster 2023-07-20T15:01:54.129383+0000 mon.a (mon.0) 247 : cluster [WRN] Health check failed: 1 host (1 osds) down (OSD_HOST_DOWN) 2023-07-20T15:01:55.138 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:54 smithi029 bash[104935]: cluster 2023-07-20T15:01:54.129398+0000 mon.a (mon.0) 248 : cluster [WRN] Health check failed: 1 root (1 osds) down (OSD_ROOT_DOWN) 2023-07-20T15:01:55.138 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:54 smithi029 bash[104935]: cluster 2023-07-20T15:01:54.134469+0000 mon.a (mon.0) 249 : cluster [DBG] osdmap e13: 2 total, 0 up, 1 in 2023-07-20T15:01:55.138 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:54 smithi029 bash[104935]: audit 2023-07-20T15:01:54.134641+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:55.138 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:54 smithi029 bash[104935]: audit 2023-07-20T15:01:54.566841+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"1943aeae26c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565988\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:01:54.383403\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_daemon_update\": \"2023-07-20T15:01:54.566060\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:55.138 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:54 smithi029 bash[104935]: audit 2023-07-20T15:01:54.569424+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"1943aeae26c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565988\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:01:54.383403\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_daemon_update\": \"2023-07-20T15:01:54.566060\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:55.138 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:54 smithi029 bash[104935]: audit 2023-07-20T15:01:54.569908+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:55.139 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:54 smithi029 bash[108361]: cluster 2023-07-20T15:01:54.129360+0000 mon.a (mon.0) 246 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:01:55.139 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:54 smithi029 bash[108361]: cluster 2023-07-20T15:01:54.129383+0000 mon.a (mon.0) 247 : cluster [WRN] Health check failed: 1 host (1 osds) down (OSD_HOST_DOWN) 2023-07-20T15:01:55.139 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:54 smithi029 bash[108361]: cluster 2023-07-20T15:01:54.129398+0000 mon.a (mon.0) 248 : cluster [WRN] Health check failed: 1 root (1 osds) down (OSD_ROOT_DOWN) 2023-07-20T15:01:55.139 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:54 smithi029 bash[108361]: cluster 2023-07-20T15:01:54.134469+0000 mon.a (mon.0) 249 : cluster [DBG] osdmap e13: 2 total, 0 up, 1 in 2023-07-20T15:01:55.140 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:54 smithi029 bash[108361]: audit 2023-07-20T15:01:54.134641+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:55.140 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:54 smithi029 bash[108361]: audit 2023-07-20T15:01:54.566841+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"1943aeae26c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565988\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:01:54.383403\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_daemon_update\": \"2023-07-20T15:01:54.566060\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:55.147 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:54 smithi029 bash[108361]: audit 2023-07-20T15:01:54.569424+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"1943aeae26c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565988\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:01:54.383403\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_daemon_update\": \"2023-07-20T15:01:54.566060\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:55.147 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:54 smithi029 bash[108361]: audit 2023-07-20T15:01:54.569908+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:55.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:54 smithi178 bash[104918]: cluster 2023-07-20T15:01:54.129360+0000 mon.a (mon.0) 246 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:01:55.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:54 smithi178 bash[104918]: cluster 2023-07-20T15:01:54.129383+0000 mon.a (mon.0) 247 : cluster [WRN] Health check failed: 1 host (1 osds) down (OSD_HOST_DOWN) 2023-07-20T15:01:55.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:54 smithi178 bash[104918]: cluster 2023-07-20T15:01:54.129398+0000 mon.a (mon.0) 248 : cluster [WRN] Health check failed: 1 root (1 osds) down (OSD_ROOT_DOWN) 2023-07-20T15:01:55.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:54 smithi178 bash[104918]: cluster 2023-07-20T15:01:54.134469+0000 mon.a (mon.0) 249 : cluster [DBG] osdmap e13: 2 total, 0 up, 1 in 2023-07-20T15:01:55.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:54 smithi178 bash[104918]: audit 2023-07-20T15:01:54.134641+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:55.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:54 smithi178 bash[104918]: audit 2023-07-20T15:01:54.566841+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"1943aeae26c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565988\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:01:54.383403\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_daemon_update\": \"2023-07-20T15:01:54.566060\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:55.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:54 smithi178 bash[104918]: audit 2023-07-20T15:01:54.569424+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"1943aeae26c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565988\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:01:54.383403\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_daemon_update\": \"2023-07-20T15:01:54.566060\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:55.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:54 smithi178 bash[104918]: audit 2023-07-20T15:01:54.569908+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:55.760 INFO:teuthology.orchestra.run.smithi029.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-07-20T15:01:55.761 INFO:teuthology.orchestra.run.smithi029.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-07-20T15:01:55.761 INFO:teuthology.orchestra.run.smithi029.stderr: stderr: 10+0 records in 2023-07-20T15:01:55.761 INFO:teuthology.orchestra.run.smithi029.stderr:10+0 records out 2023-07-20T15:01:55.761 INFO:teuthology.orchestra.run.smithi029.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00950138 s, 1.1 GB/s 2023-07-20T15:01:55.761 INFO:teuthology.orchestra.run.smithi029.stderr:--> Zapping successful for: 2023-07-20T15:01:55.877 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[112918]: debug 2023-07-20T15:01:55.621+0000 7f98b1094ec0 -1 osd.1 0 log_to_monitors {default=true} 2023-07-20T15:01:56.129 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[104935]: cluster 2023-07-20T15:01:55.132565+0000 mon.a (mon.0) 254 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:01:56.129 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[104935]: cluster 2023-07-20T15:01:55.132591+0000 mon.a (mon.0) 255 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (1 osds) down) 2023-07-20T15:01:56.129 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[104935]: cluster 2023-07-20T15:01:55.132608+0000 mon.a (mon.0) 256 : cluster [INF] Health check cleared: OSD_ROOT_DOWN (was: 1 root (1 osds) down) 2023-07-20T15:01:56.129 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[104935]: cluster 2023-07-20T15:01:55.135678+0000 mon.a (mon.0) 257 : cluster [INF] osd.0 [v2:172.21.15.29:6802/1634899187,v1:172.21.15.29:6803/1634899187] boot 2023-07-20T15:01:56.130 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[104935]: cluster 2023-07-20T15:01:55.135725+0000 mon.a (mon.0) 258 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2023-07-20T15:01:56.130 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[104935]: audit 2023-07-20T15:01:55.136712+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:01:56.130 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[104935]: audit 2023-07-20T15:01:55.137144+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:56.130 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[104935]: audit 2023-07-20T15:01:55.625288+0000 mon.c (mon.1) 10 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/3424740550,v1:172.21.15.29:6811/3424740550]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-20T15:01:56.130 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[104935]: audit 2023-07-20T15:01:55.626342+0000 mon.a (mon.0) 261 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-20T15:01:56.130 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[104935]: cluster 2023-07-20T15:01:55.794543+0000 mgr.y (mgr.14142) 62 : cluster [DBG] pgmap v52: 1 pgs: 1 stale+undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:56.130 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[108361]: cluster 2023-07-20T15:01:55.132565+0000 mon.a (mon.0) 254 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:01:56.131 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[108361]: cluster 2023-07-20T15:01:55.132591+0000 mon.a (mon.0) 255 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (1 osds) down) 2023-07-20T15:01:56.131 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[108361]: cluster 2023-07-20T15:01:55.132608+0000 mon.a (mon.0) 256 : cluster [INF] Health check cleared: OSD_ROOT_DOWN (was: 1 root (1 osds) down) 2023-07-20T15:01:56.131 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[108361]: cluster 2023-07-20T15:01:55.135678+0000 mon.a (mon.0) 257 : cluster [INF] osd.0 [v2:172.21.15.29:6802/1634899187,v1:172.21.15.29:6803/1634899187] boot 2023-07-20T15:01:56.131 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[108361]: cluster 2023-07-20T15:01:55.135725+0000 mon.a (mon.0) 258 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2023-07-20T15:01:56.131 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[108361]: audit 2023-07-20T15:01:55.136712+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:01:56.131 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[108361]: audit 2023-07-20T15:01:55.137144+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:56.131 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[108361]: audit 2023-07-20T15:01:55.625288+0000 mon.c (mon.1) 10 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/3424740550,v1:172.21.15.29:6811/3424740550]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-20T15:01:56.132 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[108361]: audit 2023-07-20T15:01:55.626342+0000 mon.a (mon.0) 261 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-20T15:01:56.132 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:55 smithi029 bash[108361]: cluster 2023-07-20T15:01:55.794543+0000 mgr.y (mgr.14142) 62 : cluster [DBG] pgmap v52: 1 pgs: 1 stale+undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:56.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:55 smithi178 bash[104918]: cluster 2023-07-20T15:01:55.132565+0000 mon.a (mon.0) 254 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:01:56.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:55 smithi178 bash[104918]: cluster 2023-07-20T15:01:55.132591+0000 mon.a (mon.0) 255 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (1 osds) down) 2023-07-20T15:01:56.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:55 smithi178 bash[104918]: cluster 2023-07-20T15:01:55.132608+0000 mon.a (mon.0) 256 : cluster [INF] Health check cleared: OSD_ROOT_DOWN (was: 1 root (1 osds) down) 2023-07-20T15:01:56.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:55 smithi178 bash[104918]: cluster 2023-07-20T15:01:55.135678+0000 mon.a (mon.0) 257 : cluster [INF] osd.0 [v2:172.21.15.29:6802/1634899187,v1:172.21.15.29:6803/1634899187] boot 2023-07-20T15:01:56.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:55 smithi178 bash[104918]: cluster 2023-07-20T15:01:55.135725+0000 mon.a (mon.0) 258 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2023-07-20T15:01:56.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:55 smithi178 bash[104918]: audit 2023-07-20T15:01:55.136712+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:01:56.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:55 smithi178 bash[104918]: audit 2023-07-20T15:01:55.137144+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:56.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:55 smithi178 bash[104918]: audit 2023-07-20T15:01:55.625288+0000 mon.c (mon.1) 10 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/3424740550,v1:172.21.15.29:6811/3424740550]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-20T15:01:56.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:55 smithi178 bash[104918]: audit 2023-07-20T15:01:55.626342+0000 mon.a (mon.0) 261 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-20T15:01:56.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:55 smithi178 bash[104918]: cluster 2023-07-20T15:01:55.794543+0000 mgr.y (mgr.14142) 62 : cluster [DBG] pgmap v52: 1 pgs: 1 stale+undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:56.244 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi029:vg_nvme/lv_2 2023-07-20T15:01:57.447 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:01:57 smithi029 bash[112918]: debug 2023-07-20T15:01:57.144+0000 7f9895e41700 -1 osd.1 0 waiting for initial osdmap 2023-07-20T15:01:57.447 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:01:57 smithi029 bash[112918]: debug 2023-07-20T15:01:57.147+0000 7f98a105d700 -1 osd.1 16 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2023-07-20T15:01:57.447 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:57 smithi029 bash[104935]: audit 2023-07-20T15:01:56.138980+0000 mon.a (mon.0) 262 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-07-20T15:01:57.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:57 smithi029 bash[104935]: cluster 2023-07-20T15:01:56.139042+0000 mon.a (mon.0) 263 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2023-07-20T15:01:57.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:57 smithi029 bash[104935]: audit 2023-07-20T15:01:56.139651+0000 mon.c (mon.1) 11 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/3424740550,v1:172.21.15.29:6811/3424740550]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:01:57.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:57 smithi029 bash[104935]: audit 2023-07-20T15:01:56.139907+0000 mon.a (mon.0) 264 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:01:57.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:57 smithi029 bash[104935]: audit 2023-07-20T15:01:56.142302+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:57.448 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:57 smithi029 bash[108361]: audit 2023-07-20T15:01:56.138980+0000 mon.a (mon.0) 262 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-07-20T15:01:57.448 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:57 smithi029 bash[108361]: cluster 2023-07-20T15:01:56.139042+0000 mon.a (mon.0) 263 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2023-07-20T15:01:57.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:57 smithi029 bash[108361]: audit 2023-07-20T15:01:56.139651+0000 mon.c (mon.1) 11 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/3424740550,v1:172.21.15.29:6811/3424740550]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:01:57.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:57 smithi029 bash[108361]: audit 2023-07-20T15:01:56.139907+0000 mon.a (mon.0) 264 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:01:57.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:57 smithi029 bash[108361]: audit 2023-07-20T15:01:56.142302+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:57.667 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:57 smithi178 bash[104918]: audit 2023-07-20T15:01:56.138980+0000 mon.a (mon.0) 262 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-07-20T15:01:57.668 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:57 smithi178 bash[104918]: cluster 2023-07-20T15:01:56.139042+0000 mon.a (mon.0) 263 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2023-07-20T15:01:57.668 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:57 smithi178 bash[104918]: audit 2023-07-20T15:01:56.139651+0000 mon.c (mon.1) 11 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/3424740550,v1:172.21.15.29:6811/3424740550]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:01:57.668 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:57 smithi178 bash[104918]: audit 2023-07-20T15:01:56.139907+0000 mon.a (mon.0) 264 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:01:57.668 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:57 smithi178 bash[104918]: audit 2023-07-20T15:01:56.142302+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:58.447 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[108361]: cluster 2023-07-20T15:01:56.629532+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:01:58.447 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[108361]: cluster 2023-07-20T15:01:56.629573+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:01:58.447 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[108361]: audit 2023-07-20T15:01:57.140929+0000 mon.a (mon.0) 266 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-07-20T15:01:58.447 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[108361]: cluster 2023-07-20T15:01:57.140969+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e16: 2 total, 1 up, 1 in 2023-07-20T15:01:58.448 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[108361]: audit 2023-07-20T15:01:57.141418+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:58.448 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[108361]: audit 2023-07-20T15:01:57.387136+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:58.448 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[108361]: audit 2023-07-20T15:01:57.497537+0000 mgr.y (mgr.14142) 63 : audit [DBG] from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:01:58.448 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[108361]: cephadm 2023-07-20T15:01:57.498144+0000 mgr.y (mgr.14142) 64 : cephadm [INF] Applying osd on host smithi029... 2023-07-20T15:01:58.448 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[108361]: audit 2023-07-20T15:01:57.498429+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:01:58.448 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[108361]: audit 2023-07-20T15:01:57.499148+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:58.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[108361]: audit 2023-07-20T15:01:57.500024+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:58.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[104935]: cluster 2023-07-20T15:01:56.629532+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:01:58.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[104935]: cluster 2023-07-20T15:01:56.629573+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:01:58.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[104935]: audit 2023-07-20T15:01:57.140929+0000 mon.a (mon.0) 266 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-07-20T15:01:58.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[104935]: cluster 2023-07-20T15:01:57.140969+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e16: 2 total, 1 up, 1 in 2023-07-20T15:01:58.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[104935]: audit 2023-07-20T15:01:57.141418+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:58.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[104935]: audit 2023-07-20T15:01:57.387136+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:58.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[104935]: audit 2023-07-20T15:01:57.497537+0000 mgr.y (mgr.14142) 63 : audit [DBG] from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:01:58.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[104935]: cephadm 2023-07-20T15:01:57.498144+0000 mgr.y (mgr.14142) 64 : cephadm [INF] Applying osd on host smithi029... 2023-07-20T15:01:58.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[104935]: audit 2023-07-20T15:01:57.498429+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:01:58.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[104935]: audit 2023-07-20T15:01:57.499148+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:58.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[104935]: audit 2023-07-20T15:01:57.500024+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:58.472 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[108361]: audit 2023-07-20T15:01:57.604739+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"1943aeae26c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565988\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:01:54.383403\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_daemon_update\": \"2023-07-20T15:01:54.566060\", \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:58.473 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[108361]: audit 2023-07-20T15:01:57.607594+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"1943aeae26c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565988\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:01:54.383403\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_daemon_update\": \"2023-07-20T15:01:54.566060\", \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:58.473 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[108361]: cluster 2023-07-20T15:01:57.794840+0000 mgr.y (mgr.14142) 65 : cluster [DBG] pgmap v55: 1 pgs: 1 stale+undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:58.474 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[104935]: audit 2023-07-20T15:01:57.604739+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"1943aeae26c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565988\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:01:54.383403\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_daemon_update\": \"2023-07-20T15:01:54.566060\", \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:58.474 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[104935]: audit 2023-07-20T15:01:57.607594+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"1943aeae26c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565988\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:01:54.383403\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_daemon_update\": \"2023-07-20T15:01:54.566060\", \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:58.474 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:58 smithi029 bash[104935]: cluster 2023-07-20T15:01:57.794840+0000 mgr.y (mgr.14142) 65 : cluster [DBG] pgmap v55: 1 pgs: 1 stale+undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:58.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:58 smithi178 bash[104918]: cluster 2023-07-20T15:01:56.629532+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:01:58.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:58 smithi178 bash[104918]: cluster 2023-07-20T15:01:56.629573+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:01:58.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:58 smithi178 bash[104918]: audit 2023-07-20T15:01:57.140929+0000 mon.a (mon.0) 266 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-07-20T15:01:58.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:58 smithi178 bash[104918]: cluster 2023-07-20T15:01:57.140969+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e16: 2 total, 1 up, 1 in 2023-07-20T15:01:58.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:58 smithi178 bash[104918]: audit 2023-07-20T15:01:57.141418+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:58.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:58 smithi178 bash[104918]: audit 2023-07-20T15:01:57.387136+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:01:58.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:58 smithi178 bash[104918]: audit 2023-07-20T15:01:57.497537+0000 mgr.y (mgr.14142) 63 : audit [DBG] from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:01:58.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:58 smithi178 bash[104918]: cephadm 2023-07-20T15:01:57.498144+0000 mgr.y (mgr.14142) 64 : cephadm [INF] Applying osd on host smithi029... 2023-07-20T15:01:58.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:58 smithi178 bash[104918]: audit 2023-07-20T15:01:57.498429+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:01:58.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:58 smithi178 bash[104918]: audit 2023-07-20T15:01:57.499148+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:01:58.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:58 smithi178 bash[104918]: audit 2023-07-20T15:01:57.500024+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:01:58.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:58 smithi178 bash[104918]: audit 2023-07-20T15:01:57.604739+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"1943aeae26c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565988\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:01:54.383403\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_daemon_update\": \"2023-07-20T15:01:54.566060\", \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:01:58.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:58 smithi178 bash[104918]: audit 2023-07-20T15:01:57.607594+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"1943aeae26c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565988\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:01:54.383403\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:51.397853\"}}, \"last_daemon_update\": \"2023-07-20T15:01:54.566060\", \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:01:58.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:58 smithi178 bash[104918]: cluster 2023-07-20T15:01:57.794840+0000 mgr.y (mgr.14142) 65 : cluster [DBG] pgmap v55: 1 pgs: 1 stale+undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2023-07-20T15:01:59.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:59 smithi029 bash[104935]: cluster 2023-07-20T15:01:58.145897+0000 mon.a (mon.0) 275 : cluster [INF] osd.1 [v2:172.21.15.29:6810/3424740550,v1:172.21.15.29:6811/3424740550] boot 2023-07-20T15:01:59.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:59 smithi029 bash[104935]: cluster 2023-07-20T15:01:58.145943+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2023-07-20T15:01:59.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:59 smithi029 bash[104935]: audit 2023-07-20T15:01:58.156067+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:59.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:59 smithi029 bash[104935]: audit 2023-07-20T15:01:59.083451+0000 mon.c (mon.1) 12 : audit [INF] from='client.? 172.21.15.29:0/644595395' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a028cba-0ec6-4032-96ef-177180fe78cb"}]: dispatch 2023-07-20T15:01:59.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:59 smithi029 bash[104935]: audit 2023-07-20T15:01:59.083735+0000 mon.a (mon.0) 278 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a028cba-0ec6-4032-96ef-177180fe78cb"}]: dispatch 2023-07-20T15:01:59.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:59 smithi029 bash[104935]: audit 2023-07-20T15:01:59.086953+0000 mon.a (mon.0) 279 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a028cba-0ec6-4032-96ef-177180fe78cb"}]': finished 2023-07-20T15:01:59.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:59 smithi029 bash[104935]: cluster 2023-07-20T15:01:59.086988+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2023-07-20T15:01:59.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:01:59 smithi029 bash[104935]: audit 2023-07-20T15:01:59.087095+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:01:59.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:59 smithi029 bash[108361]: cluster 2023-07-20T15:01:58.145897+0000 mon.a (mon.0) 275 : cluster [INF] osd.1 [v2:172.21.15.29:6810/3424740550,v1:172.21.15.29:6811/3424740550] boot 2023-07-20T15:01:59.480 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:59 smithi029 bash[108361]: cluster 2023-07-20T15:01:58.145943+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2023-07-20T15:01:59.481 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:59 smithi029 bash[108361]: audit 2023-07-20T15:01:58.156067+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:59.481 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:59 smithi029 bash[108361]: audit 2023-07-20T15:01:59.083451+0000 mon.c (mon.1) 12 : audit [INF] from='client.? 172.21.15.29:0/644595395' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a028cba-0ec6-4032-96ef-177180fe78cb"}]: dispatch 2023-07-20T15:01:59.481 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:59 smithi029 bash[108361]: audit 2023-07-20T15:01:59.083735+0000 mon.a (mon.0) 278 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a028cba-0ec6-4032-96ef-177180fe78cb"}]: dispatch 2023-07-20T15:01:59.481 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:59 smithi029 bash[108361]: audit 2023-07-20T15:01:59.086953+0000 mon.a (mon.0) 279 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a028cba-0ec6-4032-96ef-177180fe78cb"}]': finished 2023-07-20T15:01:59.481 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:59 smithi029 bash[108361]: cluster 2023-07-20T15:01:59.086988+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2023-07-20T15:01:59.481 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:01:59 smithi029 bash[108361]: audit 2023-07-20T15:01:59.087095+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:01:59.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:59 smithi178 bash[104918]: cluster 2023-07-20T15:01:58.145897+0000 mon.a (mon.0) 275 : cluster [INF] osd.1 [v2:172.21.15.29:6810/3424740550,v1:172.21.15.29:6811/3424740550] boot 2023-07-20T15:01:59.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:59 smithi178 bash[104918]: cluster 2023-07-20T15:01:58.145943+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2023-07-20T15:01:59.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:59 smithi178 bash[104918]: audit 2023-07-20T15:01:58.156067+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:01:59.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:59 smithi178 bash[104918]: audit 2023-07-20T15:01:59.083451+0000 mon.c (mon.1) 12 : audit [INF] from='client.? 172.21.15.29:0/644595395' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a028cba-0ec6-4032-96ef-177180fe78cb"}]: dispatch 2023-07-20T15:01:59.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:59 smithi178 bash[104918]: audit 2023-07-20T15:01:59.083735+0000 mon.a (mon.0) 278 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a028cba-0ec6-4032-96ef-177180fe78cb"}]: dispatch 2023-07-20T15:01:59.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:59 smithi178 bash[104918]: audit 2023-07-20T15:01:59.086953+0000 mon.a (mon.0) 279 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a028cba-0ec6-4032-96ef-177180fe78cb"}]': finished 2023-07-20T15:01:59.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:59 smithi178 bash[104918]: cluster 2023-07-20T15:01:59.086988+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2023-07-20T15:01:59.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:01:59 smithi178 bash[104918]: audit 2023-07-20T15:01:59.087095+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:01.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:00 smithi178 bash[104918]: cluster 2023-07-20T15:01:59.795128+0000 mgr.y (mgr.14142) 66 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:01.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:00 smithi178 bash[104918]: audit 2023-07-20T15:01:59.839339+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.29:0/431462936' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:02:01.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:00 smithi029 bash[104935]: cluster 2023-07-20T15:01:59.795128+0000 mgr.y (mgr.14142) 66 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:01.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:00 smithi029 bash[104935]: audit 2023-07-20T15:01:59.839339+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.29:0/431462936' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:02:01.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:00 smithi029 bash[108361]: cluster 2023-07-20T15:01:59.795128+0000 mgr.y (mgr.14142) 66 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:01.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:00 smithi029 bash[108361]: audit 2023-07-20T15:01:59.839339+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.29:0/431462936' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:02:03.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:02 smithi029 bash[104935]: cluster 2023-07-20T15:02:01.795409+0000 mgr.y (mgr.14142) 67 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:03.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:02 smithi029 bash[104935]: audit 2023-07-20T15:02:02.104698+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:03.125 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:02 smithi029 bash[108361]: cluster 2023-07-20T15:02:01.795409+0000 mgr.y (mgr.14142) 67 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:03.126 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:02 smithi029 bash[108361]: audit 2023-07-20T15:02:02.104698+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:03.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:02 smithi178 bash[104918]: cluster 2023-07-20T15:02:01.795409+0000 mgr.y (mgr.14142) 67 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:03.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:02 smithi178 bash[104918]: audit 2023-07-20T15:02:02.104698+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:04.933 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:04 smithi029 bash[108361]: cluster 2023-07-20T15:02:03.795873+0000 mgr.y (mgr.14142) 68 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:04.934 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:04 smithi029 bash[108361]: audit 2023-07-20T15:02:03.839699+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-20T15:02:04.934 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:04 smithi029 bash[108361]: audit 2023-07-20T15:02:03.840337+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:04.934 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:04 smithi029 bash[108361]: audit 2023-07-20T15:02:03.841010+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2023-07-20T15:02:04.934 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:04 smithi029 bash[104935]: cluster 2023-07-20T15:02:03.795873+0000 mgr.y (mgr.14142) 68 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:04.935 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:04 smithi029 bash[104935]: audit 2023-07-20T15:02:03.839699+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-20T15:02:04.935 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:04 smithi029 bash[104935]: audit 2023-07-20T15:02:03.840337+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:04.935 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:04 smithi029 bash[104935]: audit 2023-07-20T15:02:03.841010+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2023-07-20T15:02:04.935 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:04 smithi029 systemd[1]: Stopping Ceph osd.1 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:02:04.935 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:04 smithi029 bash[112918]: debug 2023-07-20T15:02:04.883+0000 7f98a88dc700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T15:02:04.935 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:04 smithi029 bash[112918]: debug 2023-07-20T15:02:04.884+0000 7f98a88dc700 -1 osd.1 18 *** Got signal Terminated *** 2023-07-20T15:02:04.936 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:04 smithi029 bash[112918]: debug 2023-07-20T15:02:04.884+0000 7f98a88dc700 -1 osd.1 18 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-20T15:02:05.175 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:04 smithi178 bash[104918]: cluster 2023-07-20T15:02:03.795873+0000 mgr.y (mgr.14142) 68 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:05.175 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:04 smithi178 bash[104918]: audit 2023-07-20T15:02:03.839699+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-20T15:02:05.175 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:04 smithi178 bash[104918]: audit 2023-07-20T15:02:03.840337+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:05.175 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:04 smithi178 bash[104918]: audit 2023-07-20T15:02:03.841010+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2023-07-20T15:02:05.449 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:05 smithi029 podman[114145]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.1 2023-07-20T15:02:05.947 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:05 smithi029 bash[104935]: cephadm 2023-07-20T15:02:03.840782+0000 mgr.y (mgr.14142) 69 : cephadm [INF] Deploying daemon osd.1 on smithi029 2023-07-20T15:02:05.947 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:05 smithi029 bash[108361]: cephadm 2023-07-20T15:02:03.840782+0000 mgr.y (mgr.14142) 69 : cephadm [INF] Deploying daemon osd.1 on smithi029 2023-07-20T15:02:06.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:05 smithi178 bash[104918]: cephadm 2023-07-20T15:02:03.840782+0000 mgr.y (mgr.14142) 69 : cephadm [INF] Deploying daemon osd.1 on smithi029 2023-07-20T15:02:06.292 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:05 smithi029 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.1.service: Succeeded. 2023-07-20T15:02:06.292 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:05 smithi029 systemd[1]: Stopped Ceph osd.1 for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:02:06.293 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:06 smithi029 systemd[1]: Starting Ceph osd.1 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:02:06.293 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:06 smithi029 podman[114283]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.1" found: no such container 2023-07-20T15:02:06.293 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:06 smithi029 systemd[1]: Started Ceph osd.1 for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:02:06.852 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[114300]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-20T15:02:06.853 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[114300]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2023-07-20T15:02:06.853 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[114300]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2023-07-20T15:02:06.853 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[114300]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2023-07-20T15:02:06.853 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[114300]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-07-20T15:02:06.853 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[114300]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-20T15:02:06.854 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[114300]: --> ceph-volume lvm activate successful for osd ID: 1 2023-07-20T15:02:07.173 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[104935]: cluster 2023-07-20T15:02:05.796173+0000 mgr.y (mgr.14142) 70 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:07.174 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[108361]: cluster 2023-07-20T15:02:05.796173+0000 mgr.y (mgr.14142) 70 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:07.174 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[108361]: audit 2023-07-20T15:02:06.162713+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}}, \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:07.174 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[108361]: audit 2023-07-20T15:02:06.163292+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:07.184 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:06 smithi178 bash[104918]: cluster 2023-07-20T15:02:05.796173+0000 mgr.y (mgr.14142) 70 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:07.224 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:06 smithi178 bash[104918]: audit 2023-07-20T15:02:06.162713+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}}, \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:07.225 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:06 smithi178 bash[104918]: audit 2023-07-20T15:02:06.163292+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:07.231 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:06 smithi178 bash[104918]: audit 2023-07-20T15:02:06.166354+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}}, \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:07.231 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:06 smithi178 bash[104918]: audit 2023-07-20T15:02:06.166968+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-20T15:02:07.231 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:06 smithi178 bash[104918]: audit 2023-07-20T15:02:06.168059+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:07.231 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:06 smithi178 bash[104918]: audit 2023-07-20T15:02:06.168704+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2023-07-20T15:02:07.232 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[104935]: audit 2023-07-20T15:02:06.162713+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}}, \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:07.232 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[104935]: audit 2023-07-20T15:02:06.163292+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:07.233 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[108361]: audit 2023-07-20T15:02:06.166354+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}}, \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:07.233 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[108361]: audit 2023-07-20T15:02:06.166968+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-20T15:02:07.233 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[108361]: audit 2023-07-20T15:02:06.168059+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:07.233 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[108361]: audit 2023-07-20T15:02:06.168704+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2023-07-20T15:02:07.234 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[104935]: audit 2023-07-20T15:02:06.166354+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565816\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565894\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565927\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:54.565958\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}}, \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:07.242 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[104935]: audit 2023-07-20T15:02:06.166968+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-20T15:02:07.242 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[104935]: audit 2023-07-20T15:02:06.168059+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:07.243 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:06 smithi029 bash[104935]: audit 2023-07-20T15:02:06.168704+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2023-07-20T15:02:07.841 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:07 smithi029 bash[114563]: debug 2023-07-20T15:02:07.708+0000 7f3fd8b99ec0 1 -- 172.21.15.29:0/1539426448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a4faab000 msgr2=0x558a4faa7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T15:02:07.841 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:07 smithi029 bash[114563]: debug 2023-07-20T15:02:07.708+0000 7f3fd8b99ec0 1 --2- 172.21.15.29:0/1539426448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a4faab000 0x558a4faa7b00 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x558a4fa3dd10 tx=0x558a50716aa0).stop 2023-07-20T15:02:07.888 INFO:teuthology.orchestra.run.smithi029.stdout:Created osd(s) 1,2 on host 'smithi029' 2023-07-20T15:02:08.125 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:07 smithi029 bash[114563]: debug 2023-07-20T15:02:07.982+0000 7f3fd8b99ec0 -1 Falling back to public interface 2023-07-20T15:02:08.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:07 smithi029 bash[104935]: cephadm 2023-07-20T15:02:06.168500+0000 mgr.y (mgr.14142) 71 : cephadm [INF] Deploying daemon osd.2 on smithi029 2023-07-20T15:02:08.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:07 smithi029 bash[104935]: audit 2023-07-20T15:02:07.765980+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.764944\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765020\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765054\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765085\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765119\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}}, \"last_daemon_update\": \"2023-07-20T15:02:07.765198\", \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:08.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:07 smithi029 bash[104935]: audit 2023-07-20T15:02:07.769599+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.764944\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765020\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765054\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765085\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765119\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}}, \"last_daemon_update\": \"2023-07-20T15:02:07.765198\", \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:08.126 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:07 smithi029 bash[108361]: cephadm 2023-07-20T15:02:06.168500+0000 mgr.y (mgr.14142) 71 : cephadm [INF] Deploying daemon osd.2 on smithi029 2023-07-20T15:02:08.127 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:07 smithi029 bash[108361]: audit 2023-07-20T15:02:07.765980+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.764944\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765020\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765054\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765085\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765119\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}}, \"last_daemon_update\": \"2023-07-20T15:02:07.765198\", \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:08.127 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:07 smithi029 bash[108361]: audit 2023-07-20T15:02:07.769599+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.764944\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765020\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765054\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765085\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765119\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}}, \"last_daemon_update\": \"2023-07-20T15:02:07.765198\", \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:08.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:07 smithi178 bash[104918]: cephadm 2023-07-20T15:02:06.168500+0000 mgr.y (mgr.14142) 71 : cephadm [INF] Deploying daemon osd.2 on smithi029 2023-07-20T15:02:08.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:07 smithi178 bash[104918]: audit 2023-07-20T15:02:07.765980+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.764944\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765020\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765054\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765085\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765119\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}}, \"last_daemon_update\": \"2023-07-20T15:02:07.765198\", \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:08.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:07 smithi178 bash[104918]: audit 2023-07-20T15:02:07.769599+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.764944\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765020\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765054\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765085\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765119\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}}, \"last_daemon_update\": \"2023-07-20T15:02:07.765198\", \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:08.449 DEBUG:teuthology.orchestra.run.smithi029:osd.2> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.2.service 2023-07-20T15:02:08.453 INFO:tasks.cephadm:Deploying osd.3 on smithi029 with /dev/vg_nvme/lv_1... 2023-07-20T15:02:08.454 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-07-20T15:02:08.486 INFO:journalctl@ceph.osd.2.smithi029.stdout:-- Logs begin at Thu 2023-07-20 14:49:36 UTC. -- 2023-07-20T15:02:08.699 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[114563]: debug 2023-07-20T15:02:08.551+0000 7f3fd8b99ec0 -1 osd.1 18 log_to_monitors {default=true} 2023-07-20T15:02:08.700 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[114563]: debug 2023-07-20T15:02:08.560+0000 7f3fccb6a700 -1 osd.1 18 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2023-07-20T15:02:08.700 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[114742]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-20T15:02:08.700 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[114742]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2023-07-20T15:02:08.700 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[114742]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2023-07-20T15:02:08.700 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[114742]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2023-07-20T15:02:08.700 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[114742]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-07-20T15:02:08.701 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[114742]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-20T15:02:08.701 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[114742]: --> ceph-volume lvm activate successful for osd ID: 2 2023-07-20T15:02:08.972 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[104935]: cluster 2023-07-20T15:02:07.796588+0000 mgr.y (mgr.14142) 72 : cluster [DBG] pgmap v62: 1 pgs: 1 undersized+peered; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:08.975 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[108361]: cluster 2023-07-20T15:02:07.796588+0000 mgr.y (mgr.14142) 72 : cluster [DBG] pgmap v62: 1 pgs: 1 undersized+peered; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:08.976 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[104935]: audit 2023-07-20T15:02:07.838426+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.764944\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765020\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765054\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765085\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765119\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:08.976 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[104935]: audit 2023-07-20T15:02:07.838959+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:08.976 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[104935]: audit 2023-07-20T15:02:07.841385+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.764944\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765020\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765054\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765085\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765119\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:08.976 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[104935]: audit 2023-07-20T15:02:08.557431+0000 mon.a (mon.0) 297 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/1986287135,v1:172.21.15.29:6811/1986287135]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-20T15:02:08.976 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[104935]: audit 2023-07-20T15:02:08.558227+0000 mon.a (mon.0) 298 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/1986287135,v1:172.21.15.29:6811/1986287135]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:02:08.977 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[108361]: audit 2023-07-20T15:02:07.838426+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.764944\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765020\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765054\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765085\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765119\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:08.977 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[108361]: audit 2023-07-20T15:02:07.838959+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:08.977 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[108361]: audit 2023-07-20T15:02:07.841385+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.764944\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765020\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765054\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765085\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765119\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:08.977 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[108361]: audit 2023-07-20T15:02:08.557431+0000 mon.a (mon.0) 297 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/1986287135,v1:172.21.15.29:6811/1986287135]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-20T15:02:08.978 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:08 smithi029 bash[108361]: audit 2023-07-20T15:02:08.558227+0000 mon.a (mon.0) 298 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/1986287135,v1:172.21.15.29:6811/1986287135]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:02:09.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:08 smithi178 bash[104918]: cluster 2023-07-20T15:02:07.796588+0000 mgr.y (mgr.14142) 72 : cluster [DBG] pgmap v62: 1 pgs: 1 undersized+peered; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:09.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:08 smithi178 bash[104918]: audit 2023-07-20T15:02:07.838426+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.764944\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765020\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765054\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765085\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765119\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:09.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:08 smithi178 bash[104918]: audit 2023-07-20T15:02:07.838959+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:09.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:08 smithi178 bash[104918]: audit 2023-07-20T15:02:07.841385+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.764944\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765020\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765054\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765085\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:07.765119\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_device_update\": \"2023-07-20T15:01:57.604109\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:09.190 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:08 smithi178 bash[104918]: audit 2023-07-20T15:02:08.557431+0000 mon.a (mon.0) 297 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/1986287135,v1:172.21.15.29:6811/1986287135]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-20T15:02:09.190 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:08 smithi178 bash[104918]: audit 2023-07-20T15:02:08.558227+0000 mon.a (mon.0) 298 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/1986287135,v1:172.21.15.29:6811/1986287135]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:02:09.864 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:09 smithi029 bash[104935]: cluster 2023-07-20T15:02:08.839820+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:02:09.865 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:09 smithi029 bash[104935]: cluster 2023-07-20T15:02:08.843310+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e19: 3 total, 1 up, 2 in 2023-07-20T15:02:09.865 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:09 smithi029 bash[104935]: audit 2023-07-20T15:02:08.843454+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:09.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:09 smithi029 bash[104935]: audit 2023-07-20T15:02:09.590649+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"b9fb29e263d7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589888\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:09.129916\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_daemon_update\": \"2023-07-20T15:02:09.589962\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:09.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:09 smithi029 bash[104935]: audit 2023-07-20T15:02:09.593385+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"b9fb29e263d7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589888\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:09.129916\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_daemon_update\": \"2023-07-20T15:02:09.589962\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:09.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:09 smithi029 bash[104935]: audit 2023-07-20T15:02:09.594052+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:10.128 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:09 smithi029 bash[108361]: cluster 2023-07-20T15:02:08.839820+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:02:10.129 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:09 smithi029 bash[108361]: cluster 2023-07-20T15:02:08.843310+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e19: 3 total, 1 up, 2 in 2023-07-20T15:02:10.129 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:09 smithi029 bash[108361]: audit 2023-07-20T15:02:08.843454+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:10.161 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:09 smithi029 bash[108361]: audit 2023-07-20T15:02:09.590649+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"b9fb29e263d7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589888\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:09.129916\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_daemon_update\": \"2023-07-20T15:02:09.589962\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:10.161 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:09 smithi029 bash[108361]: audit 2023-07-20T15:02:09.593385+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"b9fb29e263d7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589888\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:09.129916\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_daemon_update\": \"2023-07-20T15:02:09.589962\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:10.170 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:09 smithi029 bash[108361]: audit 2023-07-20T15:02:09.594052+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:10.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:09 smithi178 bash[104918]: cluster 2023-07-20T15:02:08.839820+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:02:10.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:09 smithi178 bash[104918]: cluster 2023-07-20T15:02:08.843310+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e19: 3 total, 1 up, 2 in 2023-07-20T15:02:10.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:09 smithi178 bash[104918]: audit 2023-07-20T15:02:08.843454+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:10.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:09 smithi178 bash[104918]: audit 2023-07-20T15:02:09.590649+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"b9fb29e263d7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589888\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:09.129916\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_daemon_update\": \"2023-07-20T15:02:09.589962\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:10.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:09 smithi178 bash[104918]: audit 2023-07-20T15:02:09.593385+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"b9fb29e263d7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589888\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:09.129916\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_daemon_update\": \"2023-07-20T15:02:09.589962\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:10.220 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:09 smithi178 bash[104918]: audit 2023-07-20T15:02:09.594052+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:10.221 INFO:teuthology.orchestra.run.smithi029.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-07-20T15:02:10.221 INFO:teuthology.orchestra.run.smithi029.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-07-20T15:02:10.221 INFO:teuthology.orchestra.run.smithi029.stderr: stderr: 10+0 records in 2023-07-20T15:02:10.221 INFO:teuthology.orchestra.run.smithi029.stderr:10+0 records out 2023-07-20T15:02:10.221 INFO:teuthology.orchestra.run.smithi029.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00947002 s, 1.1 GB/s 2023-07-20T15:02:10.221 INFO:teuthology.orchestra.run.smithi029.stderr:--> Zapping successful for: 2023-07-20T15:02:10.450 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[115199]: debug 2023-07-20T15:02:10.083+0000 7fdb477deec0 -1 Falling back to public interface 2023-07-20T15:02:10.697 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[115199]: debug 2023-07-20T15:02:10.638+0000 7fdb477deec0 -1 osd.2 0 log_to_monitors {default=true} 2023-07-20T15:02:10.879 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi029:vg_nvme/lv_1 2023-07-20T15:02:11.193 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[104935]: cluster 2023-07-20T15:02:09.796907+0000 mgr.y (mgr.14142) 73 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:11.193 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[104935]: cluster 2023-07-20T15:02:09.841126+0000 mon.a (mon.0) 305 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:02:11.193 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[104935]: cluster 2023-07-20T15:02:09.844798+0000 mon.a (mon.0) 306 : cluster [INF] osd.1 [v2:172.21.15.29:6810/1986287135,v1:172.21.15.29:6811/1986287135] boot 2023-07-20T15:02:11.194 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[104935]: cluster 2023-07-20T15:02:09.844879+0000 mon.a (mon.0) 307 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2023-07-20T15:02:11.194 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[104935]: audit 2023-07-20T15:02:09.844997+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:02:11.194 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[104935]: audit 2023-07-20T15:02:09.845382+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:11.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[104935]: audit 2023-07-20T15:02:10.642910+0000 mon.c (mon.1) 14 : audit [INF] from='osd.2 [v2:172.21.15.29:6818/823081426,v1:172.21.15.29:6819/823081426]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-20T15:02:11.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[104935]: audit 2023-07-20T15:02:10.643223+0000 mon.a (mon.0) 310 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-20T15:02:11.196 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:10 smithi178 bash[104918]: cluster 2023-07-20T15:02:09.796907+0000 mgr.y (mgr.14142) 73 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:11.196 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:10 smithi178 bash[104918]: cluster 2023-07-20T15:02:09.841126+0000 mon.a (mon.0) 305 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:02:11.197 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:10 smithi178 bash[104918]: cluster 2023-07-20T15:02:09.844798+0000 mon.a (mon.0) 306 : cluster [INF] osd.1 [v2:172.21.15.29:6810/1986287135,v1:172.21.15.29:6811/1986287135] boot 2023-07-20T15:02:11.197 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:10 smithi178 bash[104918]: cluster 2023-07-20T15:02:09.844879+0000 mon.a (mon.0) 307 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2023-07-20T15:02:11.197 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:10 smithi178 bash[104918]: audit 2023-07-20T15:02:09.844997+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:02:11.197 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:10 smithi178 bash[104918]: audit 2023-07-20T15:02:09.845382+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:11.197 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:10 smithi178 bash[104918]: audit 2023-07-20T15:02:10.642910+0000 mon.c (mon.1) 14 : audit [INF] from='osd.2 [v2:172.21.15.29:6818/823081426,v1:172.21.15.29:6819/823081426]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-20T15:02:11.197 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:10 smithi178 bash[104918]: audit 2023-07-20T15:02:10.643223+0000 mon.a (mon.0) 310 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-20T15:02:11.197 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[108361]: cluster 2023-07-20T15:02:09.796907+0000 mgr.y (mgr.14142) 73 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:11.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[108361]: cluster 2023-07-20T15:02:09.841126+0000 mon.a (mon.0) 305 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:02:11.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[108361]: cluster 2023-07-20T15:02:09.844798+0000 mon.a (mon.0) 306 : cluster [INF] osd.1 [v2:172.21.15.29:6810/1986287135,v1:172.21.15.29:6811/1986287135] boot 2023-07-20T15:02:11.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[108361]: cluster 2023-07-20T15:02:09.844879+0000 mon.a (mon.0) 307 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2023-07-20T15:02:11.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[108361]: audit 2023-07-20T15:02:09.844997+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:02:11.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[108361]: audit 2023-07-20T15:02:09.845382+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:11.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[108361]: audit 2023-07-20T15:02:10.642910+0000 mon.c (mon.1) 14 : audit [INF] from='osd.2 [v2:172.21.15.29:6818/823081426,v1:172.21.15.29:6819/823081426]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-20T15:02:11.199 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:10 smithi029 bash[108361]: audit 2023-07-20T15:02:10.643223+0000 mon.a (mon.0) 310 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-20T15:02:11.898 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[108361]: audit 2023-07-20T15:02:10.846168+0000 mon.a (mon.0) 311 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-07-20T15:02:11.899 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[108361]: cluster 2023-07-20T15:02:10.846226+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e21: 3 total, 2 up, 2 in 2023-07-20T15:02:11.899 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[108361]: audit 2023-07-20T15:02:10.846363+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:11.899 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[108361]: audit 2023-07-20T15:02:10.846830+0000 mon.c (mon.1) 15 : audit [INF] from='osd.2 [v2:172.21.15.29:6818/823081426,v1:172.21.15.29:6819/823081426]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:02:11.899 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[108361]: audit 2023-07-20T15:02:10.847119+0000 mon.a (mon.0) 314 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:02:11.899 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[108361]: audit 2023-07-20T15:02:10.848613+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20230720-150015"}]: dispatch 2023-07-20T15:02:11.899 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[108361]: audit 2023-07-20T15:02:10.851332+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20230720-150015"}]': finished 2023-07-20T15:02:11.899 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[108361]: cluster 2023-07-20T15:02:11.797159+0000 mgr.y (mgr.14142) 74 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:12.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:11 smithi178 bash[104918]: audit 2023-07-20T15:02:10.846168+0000 mon.a (mon.0) 311 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-07-20T15:02:12.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:11 smithi178 bash[104918]: cluster 2023-07-20T15:02:10.846226+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e21: 3 total, 2 up, 2 in 2023-07-20T15:02:12.180 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:11 smithi178 bash[104918]: audit 2023-07-20T15:02:10.846363+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:12.181 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:11 smithi178 bash[104918]: audit 2023-07-20T15:02:10.846830+0000 mon.c (mon.1) 15 : audit [INF] from='osd.2 [v2:172.21.15.29:6818/823081426,v1:172.21.15.29:6819/823081426]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:02:12.181 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:11 smithi178 bash[104918]: audit 2023-07-20T15:02:10.847119+0000 mon.a (mon.0) 314 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:02:12.181 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:11 smithi178 bash[104918]: audit 2023-07-20T15:02:10.848613+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20230720-150015"}]: dispatch 2023-07-20T15:02:12.181 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:11 smithi178 bash[104918]: audit 2023-07-20T15:02:10.851332+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20230720-150015"}]': finished 2023-07-20T15:02:12.181 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:11 smithi178 bash[104918]: cluster 2023-07-20T15:02:11.797159+0000 mgr.y (mgr.14142) 74 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:12.206 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[115199]: debug 2023-07-20T15:02:11.851+0000 7fdb2c58b700 -1 osd.2 0 waiting for initial osdmap 2023-07-20T15:02:12.206 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[115199]: debug 2023-07-20T15:02:11.856+0000 7fdb377a7700 -1 osd.2 22 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2023-07-20T15:02:12.207 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[104935]: audit 2023-07-20T15:02:10.846168+0000 mon.a (mon.0) 311 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-07-20T15:02:12.207 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[104935]: cluster 2023-07-20T15:02:10.846226+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e21: 3 total, 2 up, 2 in 2023-07-20T15:02:12.207 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[104935]: audit 2023-07-20T15:02:10.846363+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:12.207 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[104935]: audit 2023-07-20T15:02:10.846830+0000 mon.c (mon.1) 15 : audit [INF] from='osd.2 [v2:172.21.15.29:6818/823081426,v1:172.21.15.29:6819/823081426]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:02:12.207 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[104935]: audit 2023-07-20T15:02:10.847119+0000 mon.a (mon.0) 314 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:02:12.207 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[104935]: audit 2023-07-20T15:02:10.848613+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20230720-150015"}]: dispatch 2023-07-20T15:02:12.207 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[104935]: audit 2023-07-20T15:02:10.851332+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20230720-150015"}]': finished 2023-07-20T15:02:12.208 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:11 smithi029 bash[104935]: cluster 2023-07-20T15:02:11.797159+0000 mgr.y (mgr.14142) 74 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:12.947 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[104935]: cluster 2023-07-20T15:02:11.666740+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:02:12.948 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[104935]: cluster 2023-07-20T15:02:11.666798+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:02:12.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[104935]: audit 2023-07-20T15:02:11.846965+0000 mon.a (mon.0) 317 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-07-20T15:02:12.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[104935]: cluster 2023-07-20T15:02:11.847021+0000 mon.a (mon.0) 318 : cluster [DBG] osdmap e22: 3 total, 2 up, 2 in 2023-07-20T15:02:12.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[104935]: audit 2023-07-20T15:02:11.847515+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:12.957 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[104935]: audit 2023-07-20T15:02:12.060254+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:12.958 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[108361]: cluster 2023-07-20T15:02:11.666740+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:02:12.958 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[108361]: cluster 2023-07-20T15:02:11.666798+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:02:12.958 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[108361]: audit 2023-07-20T15:02:11.846965+0000 mon.a (mon.0) 317 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-07-20T15:02:12.959 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[108361]: cluster 2023-07-20T15:02:11.847021+0000 mon.a (mon.0) 318 : cluster [DBG] osdmap e22: 3 total, 2 up, 2 in 2023-07-20T15:02:12.959 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[108361]: audit 2023-07-20T15:02:11.847515+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:12.959 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[108361]: audit 2023-07-20T15:02:12.060254+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:13.005 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[104935]: audit 2023-07-20T15:02:12.287843+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"b9fb29e263d7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589888\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:09.129916\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_daemon_update\": \"2023-07-20T15:02:09.589962\", \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:13.006 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[104935]: audit 2023-07-20T15:02:12.291459+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"b9fb29e263d7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589888\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:09.129916\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_daemon_update\": \"2023-07-20T15:02:09.589962\", \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:13.006 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[104935]: audit 2023-07-20T15:02:12.314066+0000 mgr.y (mgr.14142) 75 : audit [DBG] from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:02:13.006 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[104935]: cephadm 2023-07-20T15:02:12.314596+0000 mgr.y (mgr.14142) 76 : cephadm [INF] Applying osd on host smithi029... 2023-07-20T15:02:13.006 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[104935]: audit 2023-07-20T15:02:12.314836+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:02:13.006 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[104935]: audit 2023-07-20T15:02:12.315416+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:13.006 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[104935]: audit 2023-07-20T15:02:12.316204+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:13.007 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[108361]: audit 2023-07-20T15:02:12.287843+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"b9fb29e263d7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589888\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:09.129916\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_daemon_update\": \"2023-07-20T15:02:09.589962\", \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:13.007 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[108361]: audit 2023-07-20T15:02:12.291459+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"b9fb29e263d7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589888\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:09.129916\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_daemon_update\": \"2023-07-20T15:02:09.589962\", \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:13.007 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[108361]: audit 2023-07-20T15:02:12.314066+0000 mgr.y (mgr.14142) 75 : audit [DBG] from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:02:13.007 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[108361]: cephadm 2023-07-20T15:02:12.314596+0000 mgr.y (mgr.14142) 76 : cephadm [INF] Applying osd on host smithi029... 2023-07-20T15:02:13.008 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[108361]: audit 2023-07-20T15:02:12.314836+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:02:13.008 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[108361]: audit 2023-07-20T15:02:12.315416+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:13.008 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:12 smithi029 bash[108361]: audit 2023-07-20T15:02:12.316204+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:13.201 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:12 smithi178 bash[104918]: cluster 2023-07-20T15:02:11.666740+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:02:13.201 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:12 smithi178 bash[104918]: cluster 2023-07-20T15:02:11.666798+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:02:13.217 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:12 smithi178 bash[104918]: audit 2023-07-20T15:02:11.846965+0000 mon.a (mon.0) 317 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-07-20T15:02:13.217 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:12 smithi178 bash[104918]: cluster 2023-07-20T15:02:11.847021+0000 mon.a (mon.0) 318 : cluster [DBG] osdmap e22: 3 total, 2 up, 2 in 2023-07-20T15:02:13.218 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:12 smithi178 bash[104918]: audit 2023-07-20T15:02:11.847515+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:13.218 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:12 smithi178 bash[104918]: audit 2023-07-20T15:02:12.060254+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:13.218 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:12 smithi178 bash[104918]: audit 2023-07-20T15:02:12.287843+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"b9fb29e263d7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589888\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:09.129916\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_daemon_update\": \"2023-07-20T15:02:09.589962\", \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:13.218 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:12 smithi178 bash[104918]: audit 2023-07-20T15:02:12.291459+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"b9fb29e263d7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589888\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:09.129916\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:06.166747\"}}, \"last_daemon_update\": \"2023-07-20T15:02:09.589962\", \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:13.218 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:12 smithi178 bash[104918]: audit 2023-07-20T15:02:12.314066+0000 mgr.y (mgr.14142) 75 : audit [DBG] from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:02:13.219 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:12 smithi178 bash[104918]: cephadm 2023-07-20T15:02:12.314596+0000 mgr.y (mgr.14142) 76 : cephadm [INF] Applying osd on host smithi029... 2023-07-20T15:02:13.219 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:12 smithi178 bash[104918]: audit 2023-07-20T15:02:12.314836+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:02:13.219 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:12 smithi178 bash[104918]: audit 2023-07-20T15:02:12.315416+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:13.219 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:12 smithi178 bash[104918]: audit 2023-07-20T15:02:12.316204+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:14.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:13 smithi178 bash[104918]: cluster 2023-07-20T15:02:12.856712+0000 mon.a (mon.0) 326 : cluster [INF] osd.2 [v2:172.21.15.29:6818/823081426,v1:172.21.15.29:6819/823081426] boot 2023-07-20T15:02:14.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:13 smithi178 bash[104918]: cluster 2023-07-20T15:02:12.856758+0000 mon.a (mon.0) 327 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2023-07-20T15:02:14.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:13 smithi178 bash[104918]: audit 2023-07-20T15:02:12.856921+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:14.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:13 smithi178 bash[104918]: cluster 2023-07-20T15:02:13.797401+0000 mgr.y (mgr.14142) 77 : cluster [DBG] pgmap v70: 1 pgs: 1 peering; 0 B data, 392 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:14.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:13 smithi178 bash[104918]: audit 2023-07-20T15:02:13.825549+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.29:0/1128235600' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d7d62a7-fee8-4b91-aaef-43c33da61525"}]: dispatch 2023-07-20T15:02:14.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:13 smithi178 bash[104918]: audit 2023-07-20T15:02:13.825817+0000 mon.a (mon.0) 329 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d7d62a7-fee8-4b91-aaef-43c33da61525"}]: dispatch 2023-07-20T15:02:14.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:13 smithi178 bash[104918]: audit 2023-07-20T15:02:13.829780+0000 mon.a (mon.0) 330 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d7d62a7-fee8-4b91-aaef-43c33da61525"}]': finished 2023-07-20T15:02:14.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:13 smithi178 bash[104918]: cluster 2023-07-20T15:02:13.829836+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2023-07-20T15:02:14.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:13 smithi178 bash[104918]: audit 2023-07-20T15:02:13.829963+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:14.226 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[104935]: cluster 2023-07-20T15:02:12.856712+0000 mon.a (mon.0) 326 : cluster [INF] osd.2 [v2:172.21.15.29:6818/823081426,v1:172.21.15.29:6819/823081426] boot 2023-07-20T15:02:14.226 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[104935]: cluster 2023-07-20T15:02:12.856758+0000 mon.a (mon.0) 327 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2023-07-20T15:02:14.226 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[104935]: audit 2023-07-20T15:02:12.856921+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:14.227 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[104935]: cluster 2023-07-20T15:02:13.797401+0000 mgr.y (mgr.14142) 77 : cluster [DBG] pgmap v70: 1 pgs: 1 peering; 0 B data, 392 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:14.227 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[104935]: audit 2023-07-20T15:02:13.825549+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.29:0/1128235600' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d7d62a7-fee8-4b91-aaef-43c33da61525"}]: dispatch 2023-07-20T15:02:14.227 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[104935]: audit 2023-07-20T15:02:13.825817+0000 mon.a (mon.0) 329 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d7d62a7-fee8-4b91-aaef-43c33da61525"}]: dispatch 2023-07-20T15:02:14.227 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[104935]: audit 2023-07-20T15:02:13.829780+0000 mon.a (mon.0) 330 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d7d62a7-fee8-4b91-aaef-43c33da61525"}]': finished 2023-07-20T15:02:14.227 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[104935]: cluster 2023-07-20T15:02:13.829836+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2023-07-20T15:02:14.240 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[104935]: audit 2023-07-20T15:02:13.829963+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:14.240 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[108361]: cluster 2023-07-20T15:02:12.856712+0000 mon.a (mon.0) 326 : cluster [INF] osd.2 [v2:172.21.15.29:6818/823081426,v1:172.21.15.29:6819/823081426] boot 2023-07-20T15:02:14.241 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[108361]: cluster 2023-07-20T15:02:12.856758+0000 mon.a (mon.0) 327 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2023-07-20T15:02:14.241 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[108361]: audit 2023-07-20T15:02:12.856921+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:14.241 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[108361]: cluster 2023-07-20T15:02:13.797401+0000 mgr.y (mgr.14142) 77 : cluster [DBG] pgmap v70: 1 pgs: 1 peering; 0 B data, 392 KiB used, 177 GiB / 179 GiB avail 2023-07-20T15:02:14.241 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[108361]: audit 2023-07-20T15:02:13.825549+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.29:0/1128235600' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d7d62a7-fee8-4b91-aaef-43c33da61525"}]: dispatch 2023-07-20T15:02:14.242 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[108361]: audit 2023-07-20T15:02:13.825817+0000 mon.a (mon.0) 329 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d7d62a7-fee8-4b91-aaef-43c33da61525"}]: dispatch 2023-07-20T15:02:14.242 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[108361]: audit 2023-07-20T15:02:13.829780+0000 mon.a (mon.0) 330 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d7d62a7-fee8-4b91-aaef-43c33da61525"}]': finished 2023-07-20T15:02:14.242 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[108361]: cluster 2023-07-20T15:02:13.829836+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2023-07-20T15:02:14.242 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:13 smithi029 bash[108361]: audit 2023-07-20T15:02:13.829963+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:15.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:14 smithi178 bash[104918]: cluster 2023-07-20T15:02:13.854359+0000 mon.a (mon.0) 333 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2023-07-20T15:02:15.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:14 smithi178 bash[104918]: cluster 2023-07-20T15:02:13.854383+0000 mon.a (mon.0) 334 : cluster [INF] Cluster is now healthy 2023-07-20T15:02:15.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:14 smithi178 bash[104918]: audit 2023-07-20T15:02:14.723622+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.29:0/511624092' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:02:15.232 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:14 smithi029 bash[104935]: cluster 2023-07-20T15:02:13.854359+0000 mon.a (mon.0) 333 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2023-07-20T15:02:15.233 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:14 smithi029 bash[104935]: cluster 2023-07-20T15:02:13.854383+0000 mon.a (mon.0) 334 : cluster [INF] Cluster is now healthy 2023-07-20T15:02:15.233 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:14 smithi029 bash[104935]: audit 2023-07-20T15:02:14.723622+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.29:0/511624092' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:02:15.233 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:14 smithi029 bash[108361]: cluster 2023-07-20T15:02:13.854359+0000 mon.a (mon.0) 333 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2023-07-20T15:02:15.233 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:14 smithi029 bash[108361]: cluster 2023-07-20T15:02:13.854383+0000 mon.a (mon.0) 334 : cluster [INF] Cluster is now healthy 2023-07-20T15:02:15.233 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:14 smithi029 bash[108361]: audit 2023-07-20T15:02:14.723622+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.29:0/511624092' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:02:16.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:15 smithi178 bash[104918]: cluster 2023-07-20T15:02:15.797803+0000 mgr.y (mgr.14142) 78 : cluster [DBG] pgmap v72: 1 pgs: 1 peering; 0 B data, 592 KiB used, 265 GiB / 268 GiB avail 2023-07-20T15:02:16.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:15 smithi029 bash[104935]: cluster 2023-07-20T15:02:15.797803+0000 mgr.y (mgr.14142) 78 : cluster [DBG] pgmap v72: 1 pgs: 1 peering; 0 B data, 592 KiB used, 265 GiB / 268 GiB avail 2023-07-20T15:02:16.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:15 smithi029 bash[108361]: cluster 2023-07-20T15:02:15.797803+0000 mgr.y (mgr.14142) 78 : cluster [DBG] pgmap v72: 1 pgs: 1 peering; 0 B data, 592 KiB used, 265 GiB / 268 GiB avail 2023-07-20T15:02:17.329 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:17 smithi029 bash[104935]: audit 2023-07-20T15:02:16.963222+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:17.330 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:17 smithi029 bash[108361]: audit 2023-07-20T15:02:16.963222+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:17.419 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:17 smithi178 bash[104918]: audit 2023-07-20T15:02:16.963222+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:18.418 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:18 smithi178 bash[104918]: cluster 2023-07-20T15:02:17.798113+0000 mgr.y (mgr.14142) 79 : cluster [DBG] pgmap v73: 1 pgs: 1 peering; 0 B data, 592 KiB used, 265 GiB / 268 GiB avail 2023-07-20T15:02:18.424 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:18 smithi029 bash[104935]: cluster 2023-07-20T15:02:17.798113+0000 mgr.y (mgr.14142) 79 : cluster [DBG] pgmap v73: 1 pgs: 1 peering; 0 B data, 592 KiB used, 265 GiB / 268 GiB avail 2023-07-20T15:02:18.425 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:18 smithi029 bash[108361]: cluster 2023-07-20T15:02:17.798113+0000 mgr.y (mgr.14142) 79 : cluster [DBG] pgmap v73: 1 pgs: 1 peering; 0 B data, 592 KiB used, 265 GiB / 268 GiB avail 2023-07-20T15:02:19.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:19 smithi178 bash[104918]: audit 2023-07-20T15:02:18.710147+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-20T15:02:19.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:19 smithi178 bash[104918]: audit 2023-07-20T15:02:18.710697+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:19.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:19 smithi178 bash[104918]: cephadm 2023-07-20T15:02:18.711097+0000 mgr.y (mgr.14142) 80 : cephadm [INF] Deploying daemon osd.2 on smithi029 2023-07-20T15:02:19.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:19 smithi178 bash[104918]: audit 2023-07-20T15:02:18.711320+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2023-07-20T15:02:19.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:19 smithi029 bash[108361]: audit 2023-07-20T15:02:18.710147+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-20T15:02:19.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:19 smithi029 bash[108361]: audit 2023-07-20T15:02:18.710697+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:19.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:19 smithi029 bash[108361]: cephadm 2023-07-20T15:02:18.711097+0000 mgr.y (mgr.14142) 80 : cephadm [INF] Deploying daemon osd.2 on smithi029 2023-07-20T15:02:19.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:19 smithi029 bash[108361]: audit 2023-07-20T15:02:18.711320+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2023-07-20T15:02:19.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:19 smithi029 bash[104935]: audit 2023-07-20T15:02:18.710147+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-20T15:02:19.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:19 smithi029 bash[104935]: audit 2023-07-20T15:02:18.710697+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:19.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:19 smithi029 bash[104935]: cephadm 2023-07-20T15:02:18.711097+0000 mgr.y (mgr.14142) 80 : cephadm [INF] Deploying daemon osd.2 on smithi029 2023-07-20T15:02:19.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:19 smithi029 bash[104935]: audit 2023-07-20T15:02:18.711320+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2023-07-20T15:02:19.780 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:19 smithi029 systemd[1]: Stopping Ceph osd.2 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:02:20.058 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:19 smithi029 bash[115199]: debug 2023-07-20T15:02:19.735+0000 7fdb3f026700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T15:02:20.058 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:19 smithi029 bash[115199]: debug 2023-07-20T15:02:19.735+0000 7fdb3f026700 -1 osd.2 24 *** Got signal Terminated *** 2023-07-20T15:02:20.059 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:19 smithi029 bash[115199]: debug 2023-07-20T15:02:19.735+0000 7fdb3f026700 -1 osd.2 24 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-20T15:02:20.398 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:20 smithi029 podman[116391]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.2 2023-07-20T15:02:21.162 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[104935]: cluster 2023-07-20T15:02:19.798440+0000 mgr.y (mgr.14142) 81 : cluster [DBG] pgmap v74: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:21.163 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[104935]: cluster 2023-07-20T15:02:19.982656+0000 mon.a (mon.0) 339 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-07-20T15:02:21.163 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[104935]: cluster 2023-07-20T15:02:19.982687+0000 mon.a (mon.0) 340 : cluster [INF] osd.2 failed (root=default,host=smithi029) (connection refused reported by osd.1) 2023-07-20T15:02:21.163 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[104935]: cluster 2023-07-20T15:02:19.982808+0000 mon.a (mon.0) 341 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-07-20T15:02:21.163 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[104935]: cluster 2023-07-20T15:02:19.982891+0000 mon.a (mon.0) 342 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-07-20T15:02:21.163 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[104935]: cluster 2023-07-20T15:02:19.983061+0000 mon.a (mon.0) 343 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-07-20T15:02:21.164 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[104935]: cluster 2023-07-20T15:02:20.383585+0000 mon.a (mon.0) 344 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-07-20T15:02:21.164 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[104935]: cluster 2023-07-20T15:02:20.383756+0000 mon.a (mon.0) 345 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-07-20T15:02:21.164 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[104935]: cluster 2023-07-20T15:02:20.383942+0000 mon.a (mon.0) 346 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-07-20T15:02:21.164 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[104935]: cluster 2023-07-20T15:02:20.384123+0000 mon.a (mon.0) 347 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-07-20T15:02:21.164 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[108361]: cluster 2023-07-20T15:02:19.798440+0000 mgr.y (mgr.14142) 81 : cluster [DBG] pgmap v74: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:21.165 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[108361]: cluster 2023-07-20T15:02:19.982656+0000 mon.a (mon.0) 339 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-07-20T15:02:21.165 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[108361]: cluster 2023-07-20T15:02:19.982687+0000 mon.a (mon.0) 340 : cluster [INF] osd.2 failed (root=default,host=smithi029) (connection refused reported by osd.1) 2023-07-20T15:02:21.165 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[108361]: cluster 2023-07-20T15:02:19.982808+0000 mon.a (mon.0) 341 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-07-20T15:02:21.165 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[108361]: cluster 2023-07-20T15:02:19.982891+0000 mon.a (mon.0) 342 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-07-20T15:02:21.165 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[108361]: cluster 2023-07-20T15:02:19.983061+0000 mon.a (mon.0) 343 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-07-20T15:02:21.165 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[108361]: cluster 2023-07-20T15:02:20.383585+0000 mon.a (mon.0) 344 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-07-20T15:02:21.171 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[108361]: cluster 2023-07-20T15:02:20.383756+0000 mon.a (mon.0) 345 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-07-20T15:02:21.171 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[108361]: cluster 2023-07-20T15:02:20.383942+0000 mon.a (mon.0) 346 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-07-20T15:02:21.171 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:20 smithi029 bash[108361]: cluster 2023-07-20T15:02:20.384123+0000 mon.a (mon.0) 347 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-07-20T15:02:21.171 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:20 smithi029 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.2.service: Succeeded. 2023-07-20T15:02:21.172 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:20 smithi029 systemd[1]: Stopped Ceph osd.2 for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:02:21.172 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:20 smithi029 systemd[1]: Starting Ceph osd.2 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:02:21.172 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:20 smithi029 podman[116527]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.2" found: no such container 2023-07-20T15:02:21.172 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:20 smithi029 systemd[1]: Started Ceph osd.2 for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:02:21.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:20 smithi178 bash[104918]: cluster 2023-07-20T15:02:19.798440+0000 mgr.y (mgr.14142) 81 : cluster [DBG] pgmap v74: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:21.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:20 smithi178 bash[104918]: cluster 2023-07-20T15:02:19.982656+0000 mon.a (mon.0) 339 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-07-20T15:02:21.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:20 smithi178 bash[104918]: cluster 2023-07-20T15:02:19.982687+0000 mon.a (mon.0) 340 : cluster [INF] osd.2 failed (root=default,host=smithi029) (connection refused reported by osd.1) 2023-07-20T15:02:21.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:20 smithi178 bash[104918]: cluster 2023-07-20T15:02:19.982808+0000 mon.a (mon.0) 341 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-07-20T15:02:21.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:20 smithi178 bash[104918]: cluster 2023-07-20T15:02:19.982891+0000 mon.a (mon.0) 342 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-07-20T15:02:21.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:20 smithi178 bash[104918]: cluster 2023-07-20T15:02:19.983061+0000 mon.a (mon.0) 343 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-07-20T15:02:21.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:20 smithi178 bash[104918]: cluster 2023-07-20T15:02:20.383585+0000 mon.a (mon.0) 344 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-07-20T15:02:21.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:20 smithi178 bash[104918]: cluster 2023-07-20T15:02:20.383756+0000 mon.a (mon.0) 345 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-07-20T15:02:21.197 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:20 smithi178 bash[104918]: cluster 2023-07-20T15:02:20.383942+0000 mon.a (mon.0) 346 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-07-20T15:02:21.197 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:20 smithi178 bash[104918]: cluster 2023-07-20T15:02:20.384123+0000 mon.a (mon.0) 347 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-07-20T15:02:21.714 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[116543]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-20T15:02:21.714 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[116543]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2023-07-20T15:02:21.714 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[116543]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2023-07-20T15:02:21.715 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[116543]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2023-07-20T15:02:21.715 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[116543]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-07-20T15:02:21.715 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[116543]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-20T15:02:21.715 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[116543]: --> ceph-volume lvm activate successful for osd ID: 2 2023-07-20T15:02:22.143 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[104935]: cluster 2023-07-20T15:02:20.797202+0000 mon.a (mon.0) 348 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:02:22.144 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[104935]: cluster 2023-07-20T15:02:20.803852+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e25: 4 total, 2 up, 3 in 2023-07-20T15:02:22.152 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[104935]: audit 2023-07-20T15:02:20.804005+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:22.153 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[108361]: cluster 2023-07-20T15:02:20.797202+0000 mon.a (mon.0) 348 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:02:22.154 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[108361]: cluster 2023-07-20T15:02:20.803852+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e25: 4 total, 2 up, 3 in 2023-07-20T15:02:22.154 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[108361]: audit 2023-07-20T15:02:20.804005+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:22.154 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[104935]: audit 2023-07-20T15:02:21.005567+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}}, \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:22.155 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[104935]: audit 2023-07-20T15:02:21.006114+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:22.155 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[104935]: audit 2023-07-20T15:02:21.008810+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}}, \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:22.155 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[104935]: audit 2023-07-20T15:02:21.009232+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-20T15:02:22.155 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[104935]: audit 2023-07-20T15:02:21.011202+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:22.155 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[104935]: audit 2023-07-20T15:02:21.012282+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2023-07-20T15:02:22.156 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[108361]: audit 2023-07-20T15:02:21.005567+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}}, \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:22.156 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[108361]: audit 2023-07-20T15:02:21.006114+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:22.180 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[108361]: audit 2023-07-20T15:02:21.008810+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}}, \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:22.180 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[108361]: audit 2023-07-20T15:02:21.009232+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-20T15:02:22.180 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[108361]: audit 2023-07-20T15:02:21.011202+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:22.180 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:21 smithi029 bash[108361]: audit 2023-07-20T15:02:21.012282+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2023-07-20T15:02:22.181 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:21 smithi178 bash[104918]: cluster 2023-07-20T15:02:20.797202+0000 mon.a (mon.0) 348 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:02:22.181 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:21 smithi178 bash[104918]: cluster 2023-07-20T15:02:20.803852+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e25: 4 total, 2 up, 3 in 2023-07-20T15:02:22.182 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:21 smithi178 bash[104918]: audit 2023-07-20T15:02:20.804005+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:22.182 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:21 smithi178 bash[104918]: audit 2023-07-20T15:02:21.005567+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}}, \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:22.182 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:21 smithi178 bash[104918]: audit 2023-07-20T15:02:21.006114+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:22.182 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:21 smithi178 bash[104918]: audit 2023-07-20T15:02:21.008810+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}}, \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:22.182 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:21 smithi178 bash[104918]: audit 2023-07-20T15:02:21.009232+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-20T15:02:22.182 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:21 smithi178 bash[104918]: audit 2023-07-20T15:02:21.011202+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:22.182 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:21 smithi178 bash[104918]: audit 2023-07-20T15:02:21.012282+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2023-07-20T15:02:22.588 INFO:teuthology.orchestra.run.smithi029.stdout:Created osd(s) 2,3 on host 'smithi029' 2023-07-20T15:02:22.838 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[116908]: debug 2023-07-20T15:02:22.587+0000 7fb27bd82700 1 --2- 172.21.15.29:0/250524035 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d3fdf1ac00 0x55d3fdf17680 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x55d3fdeadd70 tx=0x55d3feb86aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2023-07-20T15:02:22.838 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[116908]: debug 2023-07-20T15:02:22.588+0000 7fb27ad80700 1 -- 172.21.15.29:0/250524035 <== mon.1 v2:172.21.15.29:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d3fdeb24e0 con 0x55d3fdf1ac00 2023-07-20T15:02:22.938 DEBUG:teuthology.orchestra.run.smithi029:osd.3> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.3.service 2023-07-20T15:02:22.948 INFO:tasks.cephadm:Deploying osd.4 on smithi178 with /dev/vg_nvme/lv_4... 2023-07-20T15:02:22.954 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-07-20T15:02:22.983 INFO:journalctl@ceph.osd.3.smithi029.stdout:-- Logs begin at Thu 2023-07-20 14:49:36 UTC. -- 2023-07-20T15:02:23.154 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[104935]: cephadm 2023-07-20T15:02:21.012050+0000 mgr.y (mgr.14142) 82 : cephadm [INF] Deploying daemon osd.3 on smithi029 2023-07-20T15:02:23.154 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[104935]: cluster 2023-07-20T15:02:21.798722+0000 mgr.y (mgr.14142) 83 : cluster [DBG] pgmap v76: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:23.154 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[104935]: cluster 2023-07-20T15:02:21.804375+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e26: 4 total, 2 up, 3 in 2023-07-20T15:02:23.155 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[104935]: audit 2023-07-20T15:02:21.805059+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:23.156 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[108361]: cephadm 2023-07-20T15:02:21.012050+0000 mgr.y (mgr.14142) 82 : cephadm [INF] Deploying daemon osd.3 on smithi029 2023-07-20T15:02:23.156 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[108361]: cluster 2023-07-20T15:02:21.798722+0000 mgr.y (mgr.14142) 83 : cluster [DBG] pgmap v76: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:23.157 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[108361]: cluster 2023-07-20T15:02:21.804375+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e26: 4 total, 2 up, 3 in 2023-07-20T15:02:23.157 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[108361]: audit 2023-07-20T15:02:21.805059+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:23.157 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[104935]: audit 2023-07-20T15:02:22.538700+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:23.166 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[108361]: audit 2023-07-20T15:02:22.538700+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:23.167 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[104935]: audit 2023-07-20T15:02:22.541705+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:23.167 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[108361]: audit 2023-07-20T15:02:22.541705+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:23.168 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[104935]: audit 2023-07-20T15:02:22.615735+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614803\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614947\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614978\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.615007\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:22.615081\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:23.174 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[104935]: audit 2023-07-20T15:02:22.618687+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614803\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614947\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614978\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.615007\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:22.615081\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:23.174 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[104935]: audit 2023-07-20T15:02:22.619265+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:23.176 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[108361]: audit 2023-07-20T15:02:22.615735+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614803\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614947\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614978\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.615007\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:22.615081\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:23.177 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[108361]: audit 2023-07-20T15:02:22.618687+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614803\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614947\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614978\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.615007\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:22.615081\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:23.178 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:22 smithi029 bash[108361]: audit 2023-07-20T15:02:22.619265+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:23.182 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:22 smithi178 bash[104918]: cephadm 2023-07-20T15:02:21.012050+0000 mgr.y (mgr.14142) 82 : cephadm [INF] Deploying daemon osd.3 on smithi029 2023-07-20T15:02:23.182 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:22 smithi178 bash[104918]: cluster 2023-07-20T15:02:21.798722+0000 mgr.y (mgr.14142) 83 : cluster [DBG] pgmap v76: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:23.182 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:22 smithi178 bash[104918]: cluster 2023-07-20T15:02:21.804375+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e26: 4 total, 2 up, 3 in 2023-07-20T15:02:23.182 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:22 smithi178 bash[104918]: audit 2023-07-20T15:02:21.805059+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:23.183 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:22 smithi178 bash[104918]: audit 2023-07-20T15:02:22.538700+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:23.183 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:22 smithi178 bash[104918]: audit 2023-07-20T15:02:22.541705+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589687\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589764\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589797\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589828\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:09.589859\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_device_update\": \"2023-07-20T15:02:12.287157\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:23.183 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:22 smithi178 bash[104918]: audit 2023-07-20T15:02:22.615735+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614803\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614947\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614978\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.615007\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:22.615081\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:23.183 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:22 smithi178 bash[104918]: audit 2023-07-20T15:02:22.618687+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614803\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614947\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614978\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.615007\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:22.615081\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:23.183 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:22 smithi178 bash[104918]: audit 2023-07-20T15:02:22.619265+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:23.448 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:23 smithi029 bash[116908]: debug 2023-07-20T15:02:23.109+0000 7fb281d35ec0 -1 Falling back to public interface 2023-07-20T15:02:23.449 INFO:journalctl@ceph.osd.3.smithi029.stdout:Jul 20 15:02:23 smithi029 bash[116981]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-20T15:02:23.449 INFO:journalctl@ceph.osd.3.smithi029.stdout:Jul 20 15:02:23 smithi029 bash[116981]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2023-07-20T15:02:23.449 INFO:journalctl@ceph.osd.3.smithi029.stdout:Jul 20 15:02:23 smithi029 bash[116981]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2023-07-20T15:02:23.449 INFO:journalctl@ceph.osd.3.smithi029.stdout:Jul 20 15:02:23 smithi029 bash[116981]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2023-07-20T15:02:23.450 INFO:journalctl@ceph.osd.3.smithi029.stdout:Jul 20 15:02:23 smithi029 bash[116981]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2023-07-20T15:02:23.450 INFO:journalctl@ceph.osd.3.smithi029.stdout:Jul 20 15:02:23 smithi029 bash[116981]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-20T15:02:23.450 INFO:journalctl@ceph.osd.3.smithi029.stdout:Jul 20 15:02:23 smithi029 bash[116981]: --> ceph-volume lvm activate successful for osd ID: 3 2023-07-20T15:02:23.835 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:23 smithi029 bash[116908]: debug 2023-07-20T15:02:23.660+0000 7fb281d35ec0 -1 osd.2 24 log_to_monitors {default=true} 2023-07-20T15:02:23.835 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:02:23 smithi029 bash[116908]: debug 2023-07-20T15:02:23.666+0000 7fb271cfe700 -1 osd.2 24 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2023-07-20T15:02:23.873 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:23 smithi178 bash[104918]: audit 2023-07-20T15:02:23.664394+0000 mon.a (mon.0) 364 : audit [INF] from='osd.2 [v2:172.21.15.29:6818/775038871,v1:172.21.15.29:6819/775038871]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-20T15:02:23.873 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:23 smithi178 bash[104918]: audit 2023-07-20T15:02:23.664727+0000 mon.a (mon.0) 365 : audit [INF] from='osd.2 [v2:172.21.15.29:6818/775038871,v1:172.21.15.29:6819/775038871]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:02:24.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:23 smithi029 bash[104935]: audit 2023-07-20T15:02:23.664394+0000 mon.a (mon.0) 364 : audit [INF] from='osd.2 [v2:172.21.15.29:6818/775038871,v1:172.21.15.29:6819/775038871]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-20T15:02:24.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:23 smithi029 bash[104935]: audit 2023-07-20T15:02:23.664727+0000 mon.a (mon.0) 365 : audit [INF] from='osd.2 [v2:172.21.15.29:6818/775038871,v1:172.21.15.29:6819/775038871]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:02:24.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:23 smithi029 bash[108361]: audit 2023-07-20T15:02:23.664394+0000 mon.a (mon.0) 364 : audit [INF] from='osd.2 [v2:172.21.15.29:6818/775038871,v1:172.21.15.29:6819/775038871]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-20T15:02:24.199 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:23 smithi029 bash[108361]: audit 2023-07-20T15:02:23.664727+0000 mon.a (mon.0) 365 : audit [INF] from='osd.2 [v2:172.21.15.29:6818/775038871,v1:172.21.15.29:6819/775038871]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:02:24.300 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-07-20T15:02:24.300 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-07-20T15:02:24.300 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2023-07-20T15:02:24.300 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2023-07-20T15:02:24.301 INFO:teuthology.orchestra.run.smithi178.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0083176 s, 1.3 GB/s 2023-07-20T15:02:24.301 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2023-07-20T15:02:24.689 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi178:vg_nvme/lv_4 2023-07-20T15:02:24.948 INFO:journalctl@ceph.osd.3.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[117321]: debug 2023-07-20T15:02:24.567+0000 7f5021cc6ec0 -1 Falling back to public interface 2023-07-20T15:02:24.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[104935]: cluster 2023-07-20T15:02:23.799103+0000 mgr.y (mgr.14142) 84 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 656 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%); 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:24.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[104935]: cluster 2023-07-20T15:02:23.808349+0000 mon.a (mon.0) 366 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:02:24.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[104935]: cluster 2023-07-20T15:02:23.808373+0000 mon.a (mon.0) 367 : cluster [INF] Cluster is now healthy 2023-07-20T15:02:24.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[104935]: cluster 2023-07-20T15:02:23.808782+0000 mon.a (mon.0) 368 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-07-20T15:02:24.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[104935]: cluster 2023-07-20T15:02:23.812436+0000 mon.a (mon.0) 369 : cluster [INF] osd.2 [v2:172.21.15.29:6818/775038871,v1:172.21.15.29:6819/775038871] boot 2023-07-20T15:02:24.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[104935]: cluster 2023-07-20T15:02:23.812502+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e27: 4 total, 3 up, 3 in 2023-07-20T15:02:24.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[104935]: audit 2023-07-20T15:02:23.813072+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:24.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[104935]: audit 2023-07-20T15:02:23.813502+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:24.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[104935]: cluster 2023-07-20T15:02:24.812904+0000 mon.a (mon.0) 373 : cluster [DBG] osdmap e28: 4 total, 3 up, 3 in 2023-07-20T15:02:24.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[104935]: audit 2023-07-20T15:02:24.813050+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:24.950 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[108361]: cluster 2023-07-20T15:02:23.799103+0000 mgr.y (mgr.14142) 84 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 656 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%); 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:24.951 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[108361]: cluster 2023-07-20T15:02:23.808349+0000 mon.a (mon.0) 366 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:02:24.951 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[108361]: cluster 2023-07-20T15:02:23.808373+0000 mon.a (mon.0) 367 : cluster [INF] Cluster is now healthy 2023-07-20T15:02:24.951 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[108361]: cluster 2023-07-20T15:02:23.808782+0000 mon.a (mon.0) 368 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-07-20T15:02:24.951 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[108361]: cluster 2023-07-20T15:02:23.812436+0000 mon.a (mon.0) 369 : cluster [INF] osd.2 [v2:172.21.15.29:6818/775038871,v1:172.21.15.29:6819/775038871] boot 2023-07-20T15:02:24.951 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[108361]: cluster 2023-07-20T15:02:23.812502+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e27: 4 total, 3 up, 3 in 2023-07-20T15:02:25.000 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[108361]: audit 2023-07-20T15:02:23.813072+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:25.000 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[108361]: audit 2023-07-20T15:02:23.813502+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:25.001 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[108361]: cluster 2023-07-20T15:02:24.812904+0000 mon.a (mon.0) 373 : cluster [DBG] osdmap e28: 4 total, 3 up, 3 in 2023-07-20T15:02:25.001 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:24 smithi029 bash[108361]: audit 2023-07-20T15:02:24.813050+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:25.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:24 smithi178 bash[104918]: cluster 2023-07-20T15:02:23.799103+0000 mgr.y (mgr.14142) 84 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 656 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%); 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:25.183 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:24 smithi178 bash[104918]: cluster 2023-07-20T15:02:23.808349+0000 mon.a (mon.0) 366 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:02:25.183 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:24 smithi178 bash[104918]: cluster 2023-07-20T15:02:23.808373+0000 mon.a (mon.0) 367 : cluster [INF] Cluster is now healthy 2023-07-20T15:02:25.183 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:24 smithi178 bash[104918]: cluster 2023-07-20T15:02:23.808782+0000 mon.a (mon.0) 368 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-07-20T15:02:25.184 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:24 smithi178 bash[104918]: cluster 2023-07-20T15:02:23.812436+0000 mon.a (mon.0) 369 : cluster [INF] osd.2 [v2:172.21.15.29:6818/775038871,v1:172.21.15.29:6819/775038871] boot 2023-07-20T15:02:25.184 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:24 smithi178 bash[104918]: cluster 2023-07-20T15:02:23.812502+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e27: 4 total, 3 up, 3 in 2023-07-20T15:02:25.184 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:24 smithi178 bash[104918]: audit 2023-07-20T15:02:23.813072+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:02:25.184 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:24 smithi178 bash[104918]: audit 2023-07-20T15:02:23.813502+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:25.184 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:24 smithi178 bash[104918]: cluster 2023-07-20T15:02:24.812904+0000 mon.a (mon.0) 373 : cluster [DBG] osdmap e28: 4 total, 3 up, 3 in 2023-07-20T15:02:25.184 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:24 smithi178 bash[104918]: audit 2023-07-20T15:02:24.813050+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:25.449 INFO:journalctl@ceph.osd.3.smithi029.stdout:Jul 20 15:02:25 smithi029 bash[117321]: debug 2023-07-20T15:02:25.116+0000 7f5021cc6ec0 -1 osd.3 0 log_to_monitors {default=true} 2023-07-20T15:02:26.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:25 smithi178 bash[104918]: audit 2023-07-20T15:02:24.974848+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:26.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:25 smithi178 bash[104918]: audit 2023-07-20T15:02:25.120729+0000 mon.a (mon.0) 376 : audit [INF] from='osd.3 [v2:172.21.15.29:6826/3537910860,v1:172.21.15.29:6827/3537910860]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-07-20T15:02:26.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:25 smithi178 bash[104918]: audit 2023-07-20T15:02:25.193113+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614803\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614947\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614978\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.615007\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:22.615081\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:26.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:25 smithi178 bash[104918]: audit 2023-07-20T15:02:25.195680+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614803\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614947\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614978\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.615007\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:22.615081\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:26.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:25 smithi178 bash[104918]: audit 2023-07-20T15:02:25.197046+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:26.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:25 smithi029 bash[104935]: audit 2023-07-20T15:02:24.974848+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:26.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:25 smithi029 bash[104935]: audit 2023-07-20T15:02:25.120729+0000 mon.a (mon.0) 376 : audit [INF] from='osd.3 [v2:172.21.15.29:6826/3537910860,v1:172.21.15.29:6827/3537910860]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-07-20T15:02:26.199 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:25 smithi029 bash[108361]: audit 2023-07-20T15:02:24.974848+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:26.199 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:25 smithi029 bash[108361]: audit 2023-07-20T15:02:25.120729+0000 mon.a (mon.0) 376 : audit [INF] from='osd.3 [v2:172.21.15.29:6826/3537910860,v1:172.21.15.29:6827/3537910860]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-07-20T15:02:26.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:25 smithi029 bash[104935]: audit 2023-07-20T15:02:25.193113+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614803\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614947\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614978\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.615007\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:22.615081\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:26.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:25 smithi029 bash[104935]: audit 2023-07-20T15:02:25.195680+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614803\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614947\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614978\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.615007\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:22.615081\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:26.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:25 smithi029 bash[104935]: audit 2023-07-20T15:02:25.197046+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:26.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:25 smithi029 bash[108361]: audit 2023-07-20T15:02:25.193113+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614803\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614947\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614978\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.615007\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:22.615081\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:26.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:25 smithi029 bash[108361]: audit 2023-07-20T15:02:25.195680+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614803\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614882\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614916\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614947\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.614978\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:22.615007\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:22.615081\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:26.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:25 smithi029 bash[108361]: audit 2023-07-20T15:02:25.197046+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:26.883 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:26 smithi178 bash[104918]: cluster 2023-07-20T15:02:25.799420+0000 mgr.y (mgr.14142) 85 : cluster [DBG] pgmap v81: 1 pgs: 1 active+undersized+degraded; 0 B data, 656 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:02:26.884 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:26 smithi178 bash[104918]: audit 2023-07-20T15:02:25.819691+0000 mon.a (mon.0) 380 : audit [INF] from='osd.3 [v2:172.21.15.29:6826/3537910860,v1:172.21.15.29:6827/3537910860]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-07-20T15:02:26.884 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:26 smithi178 bash[104918]: cluster 2023-07-20T15:02:25.819744+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e29: 4 total, 3 up, 3 in 2023-07-20T15:02:26.884 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:26 smithi178 bash[104918]: audit 2023-07-20T15:02:25.820349+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:26.884 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:26 smithi178 bash[104918]: audit 2023-07-20T15:02:25.820556+0000 mon.a (mon.0) 383 : audit [INF] from='osd.3 [v2:172.21.15.29:6826/3537910860,v1:172.21.15.29:6827/3537910860]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:02:26.884 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:26 smithi178 bash[104918]: audit 2023-07-20T15:02:25.911098+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:02:26.885 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:26 smithi178 bash[104918]: audit 2023-07-20T15:02:25.911902+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:26.885 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:26 smithi178 bash[104918]: audit 2023-07-20T15:02:25.912731+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:26.885 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:26 smithi178 bash[104918]: audit 2023-07-20T15:02:26.150080+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:26.149374\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:26.885 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:26 smithi178 bash[104918]: audit 2023-07-20T15:02:26.152711+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:26.149374\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:27.200 INFO:journalctl@ceph.osd.3.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[117321]: debug 2023-07-20T15:02:26.825+0000 7f5006a73700 -1 osd.3 0 waiting for initial osdmap 2023-07-20T15:02:27.200 INFO:journalctl@ceph.osd.3.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[117321]: debug 2023-07-20T15:02:26.832+0000 7f5011c8f700 -1 osd.3 30 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2023-07-20T15:02:27.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[104935]: cluster 2023-07-20T15:02:25.799420+0000 mgr.y (mgr.14142) 85 : cluster [DBG] pgmap v81: 1 pgs: 1 active+undersized+degraded; 0 B data, 656 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:02:27.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[104935]: audit 2023-07-20T15:02:25.819691+0000 mon.a (mon.0) 380 : audit [INF] from='osd.3 [v2:172.21.15.29:6826/3537910860,v1:172.21.15.29:6827/3537910860]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-07-20T15:02:27.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[104935]: cluster 2023-07-20T15:02:25.819744+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e29: 4 total, 3 up, 3 in 2023-07-20T15:02:27.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[104935]: audit 2023-07-20T15:02:25.820349+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:27.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[104935]: audit 2023-07-20T15:02:25.820556+0000 mon.a (mon.0) 383 : audit [INF] from='osd.3 [v2:172.21.15.29:6826/3537910860,v1:172.21.15.29:6827/3537910860]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:02:27.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[104935]: audit 2023-07-20T15:02:25.911098+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:02:27.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[104935]: audit 2023-07-20T15:02:25.911902+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:27.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[104935]: audit 2023-07-20T15:02:25.912731+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:27.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[108361]: cluster 2023-07-20T15:02:25.799420+0000 mgr.y (mgr.14142) 85 : cluster [DBG] pgmap v81: 1 pgs: 1 active+undersized+degraded; 0 B data, 656 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:02:27.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[108361]: audit 2023-07-20T15:02:25.819691+0000 mon.a (mon.0) 380 : audit [INF] from='osd.3 [v2:172.21.15.29:6826/3537910860,v1:172.21.15.29:6827/3537910860]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-07-20T15:02:27.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[108361]: cluster 2023-07-20T15:02:25.819744+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e29: 4 total, 3 up, 3 in 2023-07-20T15:02:27.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[108361]: audit 2023-07-20T15:02:25.820349+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:27.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[108361]: audit 2023-07-20T15:02:25.820556+0000 mon.a (mon.0) 383 : audit [INF] from='osd.3 [v2:172.21.15.29:6826/3537910860,v1:172.21.15.29:6827/3537910860]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:02:27.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[108361]: audit 2023-07-20T15:02:25.911098+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:02:27.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[108361]: audit 2023-07-20T15:02:25.911902+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:27.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[108361]: audit 2023-07-20T15:02:25.912731+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:27.239 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[104935]: audit 2023-07-20T15:02:26.150080+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:26.149374\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:27.240 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[104935]: audit 2023-07-20T15:02:26.152711+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:26.149374\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:27.240 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[108361]: audit 2023-07-20T15:02:26.150080+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:26.149374\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:02:27.241 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:26 smithi029 bash[108361]: audit 2023-07-20T15:02:26.152711+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}}, \"last_daemon_update\": \"2023-07-20T15:02:26.149374\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:02:28.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:27 smithi178 bash[104918]: audit 2023-07-20T15:02:25.909616+0000 mgr.y (mgr.14142) 86 : audit [DBG] from='client.34205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:02:28.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:27 smithi178 bash[104918]: cephadm 2023-07-20T15:02:25.910767+0000 mgr.y (mgr.14142) 87 : cephadm [INF] Applying osd on host smithi178... 2023-07-20T15:02:28.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:27 smithi178 bash[104918]: cluster 2023-07-20T15:02:26.130300+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:02:28.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:27 smithi178 bash[104918]: cluster 2023-07-20T15:02:26.130343+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:02:28.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:27 smithi178 bash[104918]: audit 2023-07-20T15:02:26.821531+0000 mon.a (mon.0) 389 : audit [INF] from='osd.3 [v2:172.21.15.29:6826/3537910860,v1:172.21.15.29:6827/3537910860]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-07-20T15:02:28.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:27 smithi178 bash[104918]: cluster 2023-07-20T15:02:26.821582+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e30: 4 total, 3 up, 3 in 2023-07-20T15:02:28.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:27 smithi178 bash[104918]: audit 2023-07-20T15:02:26.821797+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:28.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:27 smithi178 bash[104918]: audit 2023-07-20T15:02:27.419005+0000 mon.b (mon.2) 5 : audit [INF] from='client.? 172.21.15.178:0/220802663' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e424090f-0486-4402-887d-f4fc310d93d6"}]: dispatch 2023-07-20T15:02:28.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:27 smithi178 bash[104918]: audit 2023-07-20T15:02:27.419391+0000 mon.a (mon.0) 392 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e424090f-0486-4402-887d-f4fc310d93d6"}]: dispatch 2023-07-20T15:02:28.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:27 smithi178 bash[104918]: cluster 2023-07-20T15:02:27.424093+0000 mon.a (mon.0) 393 : cluster [INF] osd.3 [v2:172.21.15.29:6826/3537910860,v1:172.21.15.29:6827/3537910860] boot 2023-07-20T15:02:28.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:27 smithi178 bash[104918]: audit 2023-07-20T15:02:27.424147+0000 mon.a (mon.0) 394 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e424090f-0486-4402-887d-f4fc310d93d6"}]': finished 2023-07-20T15:02:28.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:27 smithi178 bash[104918]: cluster 2023-07-20T15:02:27.424202+0000 mon.a (mon.0) 395 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2023-07-20T15:02:28.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:27 smithi178 bash[104918]: audit 2023-07-20T15:02:27.424569+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:28.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:27 smithi178 bash[104918]: audit 2023-07-20T15:02:27.424799+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:28.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[104935]: audit 2023-07-20T15:02:25.909616+0000 mgr.y (mgr.14142) 86 : audit [DBG] from='client.34205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:02:28.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[104935]: cephadm 2023-07-20T15:02:25.910767+0000 mgr.y (mgr.14142) 87 : cephadm [INF] Applying osd on host smithi178... 2023-07-20T15:02:28.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[104935]: cluster 2023-07-20T15:02:26.130300+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:02:28.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[104935]: cluster 2023-07-20T15:02:26.130343+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:02:28.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[104935]: audit 2023-07-20T15:02:26.821531+0000 mon.a (mon.0) 389 : audit [INF] from='osd.3 [v2:172.21.15.29:6826/3537910860,v1:172.21.15.29:6827/3537910860]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-07-20T15:02:28.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[104935]: cluster 2023-07-20T15:02:26.821582+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e30: 4 total, 3 up, 3 in 2023-07-20T15:02:28.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[104935]: audit 2023-07-20T15:02:26.821797+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:28.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[104935]: audit 2023-07-20T15:02:27.419005+0000 mon.b (mon.2) 5 : audit [INF] from='client.? 172.21.15.178:0/220802663' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e424090f-0486-4402-887d-f4fc310d93d6"}]: dispatch 2023-07-20T15:02:28.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[104935]: audit 2023-07-20T15:02:27.419391+0000 mon.a (mon.0) 392 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e424090f-0486-4402-887d-f4fc310d93d6"}]: dispatch 2023-07-20T15:02:28.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[104935]: cluster 2023-07-20T15:02:27.424093+0000 mon.a (mon.0) 393 : cluster [INF] osd.3 [v2:172.21.15.29:6826/3537910860,v1:172.21.15.29:6827/3537910860] boot 2023-07-20T15:02:28.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[104935]: audit 2023-07-20T15:02:27.424147+0000 mon.a (mon.0) 394 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e424090f-0486-4402-887d-f4fc310d93d6"}]': finished 2023-07-20T15:02:28.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[104935]: cluster 2023-07-20T15:02:27.424202+0000 mon.a (mon.0) 395 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2023-07-20T15:02:28.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[104935]: audit 2023-07-20T15:02:27.424569+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:28.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[104935]: audit 2023-07-20T15:02:27.424799+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:28.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[108361]: audit 2023-07-20T15:02:25.909616+0000 mgr.y (mgr.14142) 86 : audit [DBG] from='client.34205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:02:28.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[108361]: cephadm 2023-07-20T15:02:25.910767+0000 mgr.y (mgr.14142) 87 : cephadm [INF] Applying osd on host smithi178... 2023-07-20T15:02:28.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[108361]: cluster 2023-07-20T15:02:26.130300+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:02:28.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[108361]: cluster 2023-07-20T15:02:26.130343+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:02:28.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[108361]: audit 2023-07-20T15:02:26.821531+0000 mon.a (mon.0) 389 : audit [INF] from='osd.3 [v2:172.21.15.29:6826/3537910860,v1:172.21.15.29:6827/3537910860]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-07-20T15:02:28.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[108361]: cluster 2023-07-20T15:02:26.821582+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e30: 4 total, 3 up, 3 in 2023-07-20T15:02:28.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[108361]: audit 2023-07-20T15:02:26.821797+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:28.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[108361]: audit 2023-07-20T15:02:27.419005+0000 mon.b (mon.2) 5 : audit [INF] from='client.? 172.21.15.178:0/220802663' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e424090f-0486-4402-887d-f4fc310d93d6"}]: dispatch 2023-07-20T15:02:28.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[108361]: audit 2023-07-20T15:02:27.419391+0000 mon.a (mon.0) 392 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e424090f-0486-4402-887d-f4fc310d93d6"}]: dispatch 2023-07-20T15:02:28.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[108361]: cluster 2023-07-20T15:02:27.424093+0000 mon.a (mon.0) 393 : cluster [INF] osd.3 [v2:172.21.15.29:6826/3537910860,v1:172.21.15.29:6827/3537910860] boot 2023-07-20T15:02:28.220 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[108361]: audit 2023-07-20T15:02:27.424147+0000 mon.a (mon.0) 394 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e424090f-0486-4402-887d-f4fc310d93d6"}]': finished 2023-07-20T15:02:28.220 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[108361]: cluster 2023-07-20T15:02:27.424202+0000 mon.a (mon.0) 395 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2023-07-20T15:02:28.221 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[108361]: audit 2023-07-20T15:02:27.424569+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:02:28.221 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:27 smithi029 bash[108361]: audit 2023-07-20T15:02:27.424799+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:29.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:28 smithi178 bash[104918]: cluster 2023-07-20T15:02:27.799807+0000 mgr.y (mgr.14142) 88 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized+degraded; 0 B data, 656 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:02:29.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:28 smithi178 bash[104918]: audit 2023-07-20T15:02:28.095815+0000 mon.b (mon.2) 6 : audit [DBG] from='client.? 172.21.15.178:0/2716239171' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:02:29.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:28 smithi029 bash[104935]: cluster 2023-07-20T15:02:27.799807+0000 mgr.y (mgr.14142) 88 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized+degraded; 0 B data, 656 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:02:29.207 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:28 smithi029 bash[104935]: audit 2023-07-20T15:02:28.095815+0000 mon.b (mon.2) 6 : audit [DBG] from='client.? 172.21.15.178:0/2716239171' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:02:29.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:28 smithi029 bash[108361]: cluster 2023-07-20T15:02:27.799807+0000 mgr.y (mgr.14142) 88 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized+degraded; 0 B data, 656 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:02:29.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:28 smithi029 bash[108361]: audit 2023-07-20T15:02:28.095815+0000 mon.b (mon.2) 6 : audit [DBG] from='client.? 172.21.15.178:0/2716239171' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:02:30.178 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:29 smithi178 bash[104918]: cluster 2023-07-20T15:02:28.830268+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e32: 5 total, 4 up, 4 in 2023-07-20T15:02:30.178 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:29 smithi178 bash[104918]: audit 2023-07-20T15:02:28.830846+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:30.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:29 smithi029 bash[104935]: cluster 2023-07-20T15:02:28.830268+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e32: 5 total, 4 up, 4 in 2023-07-20T15:02:30.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:29 smithi029 bash[104935]: audit 2023-07-20T15:02:28.830846+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:30.199 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:29 smithi029 bash[108361]: cluster 2023-07-20T15:02:28.830268+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e32: 5 total, 4 up, 4 in 2023-07-20T15:02:30.199 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:29 smithi029 bash[108361]: audit 2023-07-20T15:02:28.830846+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:31.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:30 smithi178 bash[104918]: cluster 2023-07-20T15:02:29.800095+0000 mgr.y (mgr.14142) 89 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 1.0 MiB used, 354 GiB / 358 GiB avail 2023-07-20T15:02:31.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:30 smithi178 bash[104918]: audit 2023-07-20T15:02:30.297100+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:31.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:30 smithi178 bash[104918]: cluster 2023-07-20T15:02:30.798322+0000 mon.a (mon.0) 401 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2023-07-20T15:02:31.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:30 smithi178 bash[104918]: cluster 2023-07-20T15:02:30.798379+0000 mon.a (mon.0) 402 : cluster [INF] Cluster is now healthy 2023-07-20T15:02:31.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:30 smithi029 bash[104935]: cluster 2023-07-20T15:02:29.800095+0000 mgr.y (mgr.14142) 89 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 1.0 MiB used, 354 GiB / 358 GiB avail 2023-07-20T15:02:31.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:30 smithi029 bash[104935]: audit 2023-07-20T15:02:30.297100+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:31.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:30 smithi029 bash[104935]: cluster 2023-07-20T15:02:30.798322+0000 mon.a (mon.0) 401 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2023-07-20T15:02:31.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:30 smithi029 bash[104935]: cluster 2023-07-20T15:02:30.798379+0000 mon.a (mon.0) 402 : cluster [INF] Cluster is now healthy 2023-07-20T15:02:31.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:30 smithi029 bash[108361]: cluster 2023-07-20T15:02:29.800095+0000 mgr.y (mgr.14142) 89 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 1.0 MiB used, 354 GiB / 358 GiB avail 2023-07-20T15:02:31.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:30 smithi029 bash[108361]: audit 2023-07-20T15:02:30.297100+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:31.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:30 smithi029 bash[108361]: cluster 2023-07-20T15:02:30.798322+0000 mon.a (mon.0) 401 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2023-07-20T15:02:31.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:30 smithi029 bash[108361]: cluster 2023-07-20T15:02:30.798379+0000 mon.a (mon.0) 402 : cluster [INF] Cluster is now healthy 2023-07-20T15:02:32.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:31 smithi178 bash[104918]: cluster 2023-07-20T15:02:31.800400+0000 mgr.y (mgr.14142) 90 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 1.0 MiB used, 354 GiB / 358 GiB avail 2023-07-20T15:02:32.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:31 smithi029 bash[104935]: cluster 2023-07-20T15:02:31.800400+0000 mgr.y (mgr.14142) 90 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 1.0 MiB used, 354 GiB / 358 GiB avail 2023-07-20T15:02:32.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:31 smithi029 bash[108361]: cluster 2023-07-20T15:02:31.800400+0000 mgr.y (mgr.14142) 90 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 1.0 MiB used, 354 GiB / 358 GiB avail 2023-07-20T15:02:33.050 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 4 on host 'smithi178' 2023-07-20T15:02:33.165 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:32 smithi178 bash[104918]: audit 2023-07-20T15:02:31.920418+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-20T15:02:33.165 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:32 smithi178 bash[104918]: audit 2023-07-20T15:02:31.921234+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:33.166 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:32 smithi178 bash[104918]: cephadm 2023-07-20T15:02:31.921831+0000 mgr.y (mgr.14142) 91 : cephadm [INF] Deploying daemon osd.4 on smithi178 2023-07-20T15:02:33.166 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:32 smithi178 bash[104918]: audit 2023-07-20T15:02:31.922103+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2023-07-20T15:02:33.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:32 smithi029 bash[104935]: audit 2023-07-20T15:02:31.920418+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-20T15:02:33.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:32 smithi029 bash[104935]: audit 2023-07-20T15:02:31.921234+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:33.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:32 smithi029 bash[104935]: cephadm 2023-07-20T15:02:31.921831+0000 mgr.y (mgr.14142) 91 : cephadm [INF] Deploying daemon osd.4 on smithi178 2023-07-20T15:02:33.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:32 smithi029 bash[104935]: audit 2023-07-20T15:02:31.922103+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2023-07-20T15:02:33.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:32 smithi029 bash[108361]: audit 2023-07-20T15:02:31.920418+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-20T15:02:33.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:32 smithi029 bash[108361]: audit 2023-07-20T15:02:31.921234+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:33.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:32 smithi029 bash[108361]: cephadm 2023-07-20T15:02:31.921831+0000 mgr.y (mgr.14142) 91 : cephadm [INF] Deploying daemon osd.4 on smithi178 2023-07-20T15:02:33.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:32 smithi029 bash[108361]: audit 2023-07-20T15:02:31.922103+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2023-07-20T15:02:33.970 DEBUG:teuthology.orchestra.run.smithi178:osd.4> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.4.service 2023-07-20T15:02:34.052 INFO:tasks.cephadm:Deploying osd.5 on smithi178 with /dev/vg_nvme/lv_3... 2023-07-20T15:02:34.053 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-07-20T15:02:34.078 INFO:journalctl@ceph.osd.4.smithi178.stdout:-- Logs begin at Thu 2023-07-20 14:49:59 UTC. -- 2023-07-20T15:02:34.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:33 smithi178 bash[104918]: audit 2023-07-20T15:02:33.001351+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967555\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967654\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:34.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:33 smithi178 bash[104918]: audit 2023-07-20T15:02:33.001765+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:34.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:33 smithi178 bash[104918]: audit 2023-07-20T15:02:33.005226+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967555\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967654\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:34.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:33 smithi178 bash[104918]: cluster 2023-07-20T15:02:33.800800+0000 mgr.y (mgr.14142) 92 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 354 GiB / 358 GiB avail 2023-07-20T15:02:34.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:33 smithi029 bash[104935]: audit 2023-07-20T15:02:33.001351+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967555\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967654\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:34.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:33 smithi029 bash[104935]: audit 2023-07-20T15:02:33.001765+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:34.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:33 smithi029 bash[104935]: audit 2023-07-20T15:02:33.005226+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967555\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967654\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:34.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:33 smithi029 bash[104935]: cluster 2023-07-20T15:02:33.800800+0000 mgr.y (mgr.14142) 92 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 354 GiB / 358 GiB avail 2023-07-20T15:02:34.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:33 smithi029 bash[108361]: audit 2023-07-20T15:02:33.001351+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967555\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967654\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:34.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:33 smithi029 bash[108361]: audit 2023-07-20T15:02:33.001765+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:34.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:33 smithi029 bash[108361]: audit 2023-07-20T15:02:33.005226+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967555\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:01:25.967654\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_device_update\": \"2023-07-20T15:00:52.664893\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:34.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:33 smithi029 bash[108361]: cluster 2023-07-20T15:02:33.800800+0000 mgr.y (mgr.14142) 92 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 354 GiB / 358 GiB avail 2023-07-20T15:02:35.126 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:34 smithi178 bash[107282]: debug 2023-07-20T15:02:34.923+0000 7f7da6ca1ec0 -1 Falling back to public interface 2023-07-20T15:02:35.127 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:35 smithi178 bash[104918]: audit 2023-07-20T15:02:34.544347+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"923c7e81cf37\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543598\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:34.076032\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_daemon_update\": \"2023-07-20T15:02:34.543702\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:35.127 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:35 smithi178 bash[104918]: audit 2023-07-20T15:02:34.548560+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"923c7e81cf37\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543598\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:34.076032\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_daemon_update\": \"2023-07-20T15:02:34.543702\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:35.127 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:35 smithi178 bash[104918]: audit 2023-07-20T15:02:34.549307+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:35.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:35 smithi029 bash[104935]: audit 2023-07-20T15:02:34.544347+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"923c7e81cf37\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543598\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:34.076032\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_daemon_update\": \"2023-07-20T15:02:34.543702\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:35.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:35 smithi029 bash[104935]: audit 2023-07-20T15:02:34.548560+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"923c7e81cf37\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543598\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:34.076032\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_daemon_update\": \"2023-07-20T15:02:34.543702\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:35.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:35 smithi029 bash[104935]: audit 2023-07-20T15:02:34.549307+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:35.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:35 smithi029 bash[108361]: audit 2023-07-20T15:02:34.544347+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"923c7e81cf37\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543598\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:34.076032\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_daemon_update\": \"2023-07-20T15:02:34.543702\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:35.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:35 smithi029 bash[108361]: audit 2023-07-20T15:02:34.548560+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"923c7e81cf37\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543598\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:34.076032\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_daemon_update\": \"2023-07-20T15:02:34.543702\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:35.478 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:35 smithi029 bash[108361]: audit 2023-07-20T15:02:34.549307+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:35.700 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:35 smithi178 bash[107282]: debug 2023-07-20T15:02:35.493+0000 7f7da6ca1ec0 -1 osd.4 0 log_to_monitors {default=true} 2023-07-20T15:02:36.044 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-07-20T15:02:36.045 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-07-20T15:02:36.045 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2023-07-20T15:02:36.045 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2023-07-20T15:02:36.045 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00969653 s, 1.1 GB/s 2023-07-20T15:02:36.046 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2023-07-20T15:02:36.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:36 smithi178 bash[104918]: audit 2023-07-20T15:02:35.498495+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.178:6800/1189979712,v1:172.21.15.178:6801/1189979712]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-20T15:02:36.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:36 smithi178 bash[104918]: audit 2023-07-20T15:02:35.499068+0000 mon.a (mon.0) 412 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-20T15:02:36.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:36 smithi178 bash[104918]: cluster 2023-07-20T15:02:35.801161+0000 mgr.y (mgr.14142) 93 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 354 GiB / 358 GiB avail 2023-07-20T15:02:36.477 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:36 smithi029 bash[104935]: audit 2023-07-20T15:02:35.498495+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.178:6800/1189979712,v1:172.21.15.178:6801/1189979712]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-20T15:02:36.484 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:36 smithi029 bash[104935]: audit 2023-07-20T15:02:35.499068+0000 mon.a (mon.0) 412 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-20T15:02:36.485 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:36 smithi029 bash[104935]: cluster 2023-07-20T15:02:35.801161+0000 mgr.y (mgr.14142) 93 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 354 GiB / 358 GiB avail 2023-07-20T15:02:36.485 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:36 smithi029 bash[108361]: audit 2023-07-20T15:02:35.498495+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.178:6800/1189979712,v1:172.21.15.178:6801/1189979712]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-20T15:02:36.485 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:36 smithi029 bash[108361]: audit 2023-07-20T15:02:35.499068+0000 mon.a (mon.0) 412 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-20T15:02:36.485 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:36 smithi029 bash[108361]: cluster 2023-07-20T15:02:35.801161+0000 mgr.y (mgr.14142) 93 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 354 GiB / 358 GiB avail 2023-07-20T15:02:36.503 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi178:vg_nvme/lv_3 2023-07-20T15:02:37.391 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:37 smithi178 bash[107282]: debug 2023-07-20T15:02:37.017+0000 7f7d8ba4e700 -1 osd.4 0 waiting for initial osdmap 2023-07-20T15:02:37.392 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:37 smithi178 bash[107282]: debug 2023-07-20T15:02:37.026+0000 7f7d96c6a700 -1 osd.4 34 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2023-07-20T15:02:37.392 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:37 smithi178 bash[104918]: audit 2023-07-20T15:02:36.014220+0000 mon.a (mon.0) 413 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-07-20T15:02:37.392 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:37 smithi178 bash[104918]: cluster 2023-07-20T15:02:36.014290+0000 mon.a (mon.0) 414 : cluster [DBG] osdmap e33: 5 total, 4 up, 4 in 2023-07-20T15:02:37.392 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:37 smithi178 bash[104918]: audit 2023-07-20T15:02:36.014644+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:37.392 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:37 smithi178 bash[104918]: audit 2023-07-20T15:02:36.014796+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.15.178:6800/1189979712,v1:172.21.15.178:6801/1189979712]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:37.393 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:37 smithi178 bash[104918]: audit 2023-07-20T15:02:36.015224+0000 mon.a (mon.0) 416 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:37.393 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:37 smithi178 bash[104918]: cluster 2023-07-20T15:02:36.472294+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:02:37.396 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:37 smithi178 bash[104918]: cluster 2023-07-20T15:02:36.472365+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:02:37.396 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:37 smithi178 bash[104918]: audit 2023-07-20T15:02:36.902190+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:37.447 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:37 smithi029 bash[104935]: audit 2023-07-20T15:02:36.014220+0000 mon.a (mon.0) 413 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-07-20T15:02:37.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:37 smithi029 bash[104935]: cluster 2023-07-20T15:02:36.014290+0000 mon.a (mon.0) 414 : cluster [DBG] osdmap e33: 5 total, 4 up, 4 in 2023-07-20T15:02:37.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:37 smithi029 bash[104935]: audit 2023-07-20T15:02:36.014644+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:37.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:37 smithi029 bash[104935]: audit 2023-07-20T15:02:36.014796+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.15.178:6800/1189979712,v1:172.21.15.178:6801/1189979712]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:37.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:37 smithi029 bash[104935]: audit 2023-07-20T15:02:36.015224+0000 mon.a (mon.0) 416 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:37.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:37 smithi029 bash[104935]: cluster 2023-07-20T15:02:36.472294+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:02:37.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:37 smithi029 bash[104935]: cluster 2023-07-20T15:02:36.472365+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:02:37.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:37 smithi029 bash[104935]: audit 2023-07-20T15:02:36.902190+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:37.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:37 smithi029 bash[108361]: audit 2023-07-20T15:02:36.014220+0000 mon.a (mon.0) 413 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-07-20T15:02:37.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:37 smithi029 bash[108361]: cluster 2023-07-20T15:02:36.014290+0000 mon.a (mon.0) 414 : cluster [DBG] osdmap e33: 5 total, 4 up, 4 in 2023-07-20T15:02:37.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:37 smithi029 bash[108361]: audit 2023-07-20T15:02:36.014644+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:37.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:37 smithi029 bash[108361]: audit 2023-07-20T15:02:36.014796+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.15.178:6800/1189979712,v1:172.21.15.178:6801/1189979712]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:37.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:37 smithi029 bash[108361]: audit 2023-07-20T15:02:36.015224+0000 mon.a (mon.0) 416 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:37.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:37 smithi029 bash[108361]: cluster 2023-07-20T15:02:36.472294+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:02:37.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:37 smithi029 bash[108361]: cluster 2023-07-20T15:02:36.472365+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:02:37.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:37 smithi029 bash[108361]: audit 2023-07-20T15:02:36.902190+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:38.322 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:38 smithi178 bash[104918]: audit 2023-07-20T15:02:37.015949+0000 mon.a (mon.0) 418 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-07-20T15:02:38.323 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:38 smithi178 bash[104918]: cluster 2023-07-20T15:02:37.016014+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e34: 5 total, 4 up, 4 in 2023-07-20T15:02:38.323 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:38 smithi178 bash[104918]: audit 2023-07-20T15:02:37.016760+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:38.323 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:38 smithi178 bash[104918]: audit 2023-07-20T15:02:37.095527+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"923c7e81cf37\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543598\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:34.076032\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_daemon_update\": \"2023-07-20T15:02:34.543702\", \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:38.323 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:38 smithi178 bash[104918]: audit 2023-07-20T15:02:37.098582+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"923c7e81cf37\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543598\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:34.076032\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_daemon_update\": \"2023-07-20T15:02:34.543702\", \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:38.323 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:38 smithi178 bash[104918]: cluster 2023-07-20T15:02:37.801535+0000 mgr.y (mgr.14142) 94 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 354 GiB / 358 GiB avail 2023-07-20T15:02:38.323 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:38 smithi178 bash[104918]: audit 2023-07-20T15:02:38.004587+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:02:38.324 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:38 smithi178 bash[104918]: audit 2023-07-20T15:02:38.005370+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:38.324 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:38 smithi178 bash[104918]: audit 2023-07-20T15:02:38.006541+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:38.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[104935]: audit 2023-07-20T15:02:37.015949+0000 mon.a (mon.0) 418 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-07-20T15:02:38.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[104935]: cluster 2023-07-20T15:02:37.016014+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e34: 5 total, 4 up, 4 in 2023-07-20T15:02:38.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[104935]: audit 2023-07-20T15:02:37.016760+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:38.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[108361]: audit 2023-07-20T15:02:37.015949+0000 mon.a (mon.0) 418 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-07-20T15:02:38.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[108361]: cluster 2023-07-20T15:02:37.016014+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e34: 5 total, 4 up, 4 in 2023-07-20T15:02:38.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[108361]: audit 2023-07-20T15:02:37.016760+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:38.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[104935]: audit 2023-07-20T15:02:37.095527+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"923c7e81cf37\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543598\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:34.076032\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_daemon_update\": \"2023-07-20T15:02:34.543702\", \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:38.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[108361]: audit 2023-07-20T15:02:37.095527+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"923c7e81cf37\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543598\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:34.076032\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_daemon_update\": \"2023-07-20T15:02:34.543702\", \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:38.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[104935]: audit 2023-07-20T15:02:37.098582+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"923c7e81cf37\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543598\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:34.076032\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_daemon_update\": \"2023-07-20T15:02:34.543702\", \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:38.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[104935]: cluster 2023-07-20T15:02:37.801535+0000 mgr.y (mgr.14142) 94 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 354 GiB / 358 GiB avail 2023-07-20T15:02:38.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[104935]: audit 2023-07-20T15:02:38.004587+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:02:38.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[104935]: audit 2023-07-20T15:02:38.005370+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:38.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[104935]: audit 2023-07-20T15:02:38.006541+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:38.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[108361]: audit 2023-07-20T15:02:37.098582+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"923c7e81cf37\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543598\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:34.076032\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:31.920095\"}}, \"last_daemon_update\": \"2023-07-20T15:02:34.543702\", \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:38.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[108361]: cluster 2023-07-20T15:02:37.801535+0000 mgr.y (mgr.14142) 94 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 354 GiB / 358 GiB avail 2023-07-20T15:02:38.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[108361]: audit 2023-07-20T15:02:38.004587+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:02:38.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[108361]: audit 2023-07-20T15:02:38.005370+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:38.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:38 smithi029 bash[108361]: audit 2023-07-20T15:02:38.006541+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:39.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:39 smithi178 bash[104918]: audit 2023-07-20T15:02:38.003483+0000 mgr.y (mgr.14142) 95 : audit [DBG] from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:02:39.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:39 smithi178 bash[104918]: cephadm 2023-07-20T15:02:38.004264+0000 mgr.y (mgr.14142) 96 : cephadm [INF] Applying osd on host smithi178... 2023-07-20T15:02:39.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:39 smithi178 bash[104918]: cluster 2023-07-20T15:02:38.017496+0000 mon.a (mon.0) 426 : cluster [INF] osd.4 [v2:172.21.15.178:6800/1189979712,v1:172.21.15.178:6801/1189979712] boot 2023-07-20T15:02:39.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:39 smithi178 bash[104918]: cluster 2023-07-20T15:02:38.017558+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e35: 5 total, 5 up, 5 in 2023-07-20T15:02:39.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:39 smithi178 bash[104918]: audit 2023-07-20T15:02:38.017752+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:39.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:39 smithi178 bash[104918]: cluster 2023-07-20T15:02:39.018666+0000 mon.a (mon.0) 429 : cluster [DBG] osdmap e36: 5 total, 5 up, 5 in 2023-07-20T15:02:39.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:39 smithi029 bash[104935]: audit 2023-07-20T15:02:38.003483+0000 mgr.y (mgr.14142) 95 : audit [DBG] from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:02:39.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:39 smithi029 bash[104935]: cephadm 2023-07-20T15:02:38.004264+0000 mgr.y (mgr.14142) 96 : cephadm [INF] Applying osd on host smithi178... 2023-07-20T15:02:39.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:39 smithi029 bash[104935]: cluster 2023-07-20T15:02:38.017496+0000 mon.a (mon.0) 426 : cluster [INF] osd.4 [v2:172.21.15.178:6800/1189979712,v1:172.21.15.178:6801/1189979712] boot 2023-07-20T15:02:39.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:39 smithi029 bash[104935]: cluster 2023-07-20T15:02:38.017558+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e35: 5 total, 5 up, 5 in 2023-07-20T15:02:39.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:39 smithi029 bash[104935]: audit 2023-07-20T15:02:38.017752+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:39.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:39 smithi029 bash[104935]: cluster 2023-07-20T15:02:39.018666+0000 mon.a (mon.0) 429 : cluster [DBG] osdmap e36: 5 total, 5 up, 5 in 2023-07-20T15:02:39.474 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:39 smithi029 bash[108361]: audit 2023-07-20T15:02:38.003483+0000 mgr.y (mgr.14142) 95 : audit [DBG] from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:02:39.475 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:39 smithi029 bash[108361]: cephadm 2023-07-20T15:02:38.004264+0000 mgr.y (mgr.14142) 96 : cephadm [INF] Applying osd on host smithi178... 2023-07-20T15:02:39.475 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:39 smithi029 bash[108361]: cluster 2023-07-20T15:02:38.017496+0000 mon.a (mon.0) 426 : cluster [INF] osd.4 [v2:172.21.15.178:6800/1189979712,v1:172.21.15.178:6801/1189979712] boot 2023-07-20T15:02:39.475 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:39 smithi029 bash[108361]: cluster 2023-07-20T15:02:38.017558+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e35: 5 total, 5 up, 5 in 2023-07-20T15:02:39.475 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:39 smithi029 bash[108361]: audit 2023-07-20T15:02:38.017752+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:39.475 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:39 smithi029 bash[108361]: cluster 2023-07-20T15:02:39.018666+0000 mon.a (mon.0) 429 : cluster [DBG] osdmap e36: 5 total, 5 up, 5 in 2023-07-20T15:02:40.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:40 smithi178 bash[104918]: audit 2023-07-20T15:02:39.569957+0000 mon.b (mon.2) 9 : audit [INF] from='client.? 172.21.15.178:0/1109945453' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ff93523-43ae-478c-a87c-1044653beb64"}]: dispatch 2023-07-20T15:02:40.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:40 smithi178 bash[104918]: audit 2023-07-20T15:02:39.570424+0000 mon.a (mon.0) 430 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ff93523-43ae-478c-a87c-1044653beb64"}]: dispatch 2023-07-20T15:02:40.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:40 smithi178 bash[104918]: audit 2023-07-20T15:02:39.574694+0000 mon.a (mon.0) 431 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7ff93523-43ae-478c-a87c-1044653beb64"}]': finished 2023-07-20T15:02:40.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:40 smithi178 bash[104918]: cluster 2023-07-20T15:02:39.574743+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e37: 6 total, 5 up, 5 in 2023-07-20T15:02:40.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:40 smithi178 bash[104918]: audit 2023-07-20T15:02:39.574883+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:40.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:40 smithi178 bash[104918]: cluster 2023-07-20T15:02:39.801840+0000 mgr.y (mgr.14142) 97 : cluster [DBG] pgmap v97: 1 pgs: 1 peering; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2023-07-20T15:02:40.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:40 smithi029 bash[104935]: audit 2023-07-20T15:02:39.569957+0000 mon.b (mon.2) 9 : audit [INF] from='client.? 172.21.15.178:0/1109945453' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ff93523-43ae-478c-a87c-1044653beb64"}]: dispatch 2023-07-20T15:02:40.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:40 smithi029 bash[104935]: audit 2023-07-20T15:02:39.570424+0000 mon.a (mon.0) 430 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ff93523-43ae-478c-a87c-1044653beb64"}]: dispatch 2023-07-20T15:02:40.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:40 smithi029 bash[104935]: audit 2023-07-20T15:02:39.574694+0000 mon.a (mon.0) 431 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7ff93523-43ae-478c-a87c-1044653beb64"}]': finished 2023-07-20T15:02:40.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:40 smithi029 bash[104935]: cluster 2023-07-20T15:02:39.574743+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e37: 6 total, 5 up, 5 in 2023-07-20T15:02:40.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:40 smithi029 bash[104935]: audit 2023-07-20T15:02:39.574883+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:40.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:40 smithi029 bash[104935]: cluster 2023-07-20T15:02:39.801840+0000 mgr.y (mgr.14142) 97 : cluster [DBG] pgmap v97: 1 pgs: 1 peering; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2023-07-20T15:02:40.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:40 smithi029 bash[108361]: audit 2023-07-20T15:02:39.569957+0000 mon.b (mon.2) 9 : audit [INF] from='client.? 172.21.15.178:0/1109945453' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ff93523-43ae-478c-a87c-1044653beb64"}]: dispatch 2023-07-20T15:02:40.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:40 smithi029 bash[108361]: audit 2023-07-20T15:02:39.570424+0000 mon.a (mon.0) 430 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ff93523-43ae-478c-a87c-1044653beb64"}]: dispatch 2023-07-20T15:02:40.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:40 smithi029 bash[108361]: audit 2023-07-20T15:02:39.574694+0000 mon.a (mon.0) 431 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7ff93523-43ae-478c-a87c-1044653beb64"}]': finished 2023-07-20T15:02:40.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:40 smithi029 bash[108361]: cluster 2023-07-20T15:02:39.574743+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e37: 6 total, 5 up, 5 in 2023-07-20T15:02:40.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:40 smithi029 bash[108361]: audit 2023-07-20T15:02:39.574883+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:40.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:40 smithi029 bash[108361]: cluster 2023-07-20T15:02:39.801840+0000 mgr.y (mgr.14142) 97 : cluster [DBG] pgmap v97: 1 pgs: 1 peering; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2023-07-20T15:02:41.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:41 smithi178 bash[104918]: audit 2023-07-20T15:02:40.246287+0000 mon.b (mon.2) 10 : audit [DBG] from='client.? 172.21.15.178:0/1941505769' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:02:41.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:41 smithi029 bash[104935]: audit 2023-07-20T15:02:40.246287+0000 mon.b (mon.2) 10 : audit [DBG] from='client.? 172.21.15.178:0/1941505769' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:02:41.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:41 smithi029 bash[108361]: audit 2023-07-20T15:02:40.246287+0000 mon.b (mon.2) 10 : audit [DBG] from='client.? 172.21.15.178:0/1941505769' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:02:42.351 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:42 smithi178 bash[104918]: cluster 2023-07-20T15:02:41.802306+0000 mgr.y (mgr.14142) 98 : cluster [DBG] pgmap v98: 1 pgs: 1 peering; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2023-07-20T15:02:42.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:42 smithi029 bash[104935]: cluster 2023-07-20T15:02:41.802306+0000 mgr.y (mgr.14142) 98 : cluster [DBG] pgmap v98: 1 pgs: 1 peering; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2023-07-20T15:02:42.473 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:42 smithi029 bash[108361]: cluster 2023-07-20T15:02:41.802306+0000 mgr.y (mgr.14142) 98 : cluster [DBG] pgmap v98: 1 pgs: 1 peering; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2023-07-20T15:02:43.330 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:43 smithi178 bash[104918]: audit 2023-07-20T15:02:42.486491+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:43.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:43 smithi029 bash[104935]: audit 2023-07-20T15:02:42.486491+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:43.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:43 smithi029 bash[108361]: audit 2023-07-20T15:02:42.486491+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:44.411 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:44 smithi178 bash[104918]: cluster 2023-07-20T15:02:43.802679+0000 mgr.y (mgr.14142) 99 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:44.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:44 smithi029 bash[104935]: cluster 2023-07-20T15:02:43.802679+0000 mgr.y (mgr.14142) 99 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:44.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:44 smithi029 bash[108361]: cluster 2023-07-20T15:02:43.802679+0000 mgr.y (mgr.14142) 99 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:45.190 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:45 smithi178 bash[104918]: audit 2023-07-20T15:02:44.084658+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-20T15:02:45.190 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:45 smithi178 bash[104918]: audit 2023-07-20T15:02:44.085488+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:45.191 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:45 smithi178 bash[104918]: cephadm 2023-07-20T15:02:44.086083+0000 mgr.y (mgr.14142) 100 : cephadm [INF] Deploying daemon osd.4 on smithi178 2023-07-20T15:02:45.191 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:45 smithi178 bash[104918]: audit 2023-07-20T15:02:44.086396+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2023-07-20T15:02:45.191 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:45 smithi178 systemd[1]: Stopping Ceph osd.4 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:02:45.191 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:45 smithi178 bash[107282]: debug 2023-07-20T15:02:45.101+0000 7f7d9e4e9700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T15:02:45.191 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:45 smithi178 bash[107282]: debug 2023-07-20T15:02:45.101+0000 7f7d9e4e9700 -1 osd.4 37 *** Got signal Terminated *** 2023-07-20T15:02:45.192 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:45 smithi178 bash[107282]: debug 2023-07-20T15:02:45.101+0000 7f7d9e4e9700 -1 osd.4 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-20T15:02:45.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:45 smithi029 bash[104935]: audit 2023-07-20T15:02:44.084658+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-20T15:02:45.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:45 smithi029 bash[104935]: audit 2023-07-20T15:02:44.085488+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:45.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:45 smithi029 bash[104935]: cephadm 2023-07-20T15:02:44.086083+0000 mgr.y (mgr.14142) 100 : cephadm [INF] Deploying daemon osd.4 on smithi178 2023-07-20T15:02:45.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:45 smithi029 bash[104935]: audit 2023-07-20T15:02:44.086396+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2023-07-20T15:02:45.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:45 smithi029 bash[108361]: audit 2023-07-20T15:02:44.084658+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-20T15:02:45.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:45 smithi029 bash[108361]: audit 2023-07-20T15:02:44.085488+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:45.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:45 smithi029 bash[108361]: cephadm 2023-07-20T15:02:44.086083+0000 mgr.y (mgr.14142) 100 : cephadm [INF] Deploying daemon osd.4 on smithi178 2023-07-20T15:02:45.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:45 smithi029 bash[108361]: audit 2023-07-20T15:02:44.086396+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2023-07-20T15:02:45.548 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:45 smithi178 podman[108582]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.4 2023-07-20T15:02:46.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.143404+0000 mon.a (mon.0) 438 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-07-20T15:02:46.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.143453+0000 mon.a (mon.0) 439 : cluster [INF] osd.4 failed (root=default,host=smithi178) (connection refused reported by osd.2) 2023-07-20T15:02:46.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.143590+0000 mon.a (mon.0) 440 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.143642+0000 mon.a (mon.0) 441 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.143791+0000 mon.a (mon.0) 442 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.143847+0000 mon.a (mon.0) 443 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.144023+0000 mon.a (mon.0) 444 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.144108+0000 mon.a (mon.0) 445 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.343972+0000 mon.a (mon.0) 446 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.344207+0000 mon.a (mon.0) 447 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-07-20T15:02:46.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.344362+0000 mon.a (mon.0) 448 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.344518+0000 mon.a (mon.0) 449 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-07-20T15:02:46.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.344635+0000 mon.a (mon.0) 450 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.307 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.344715+0000 mon.a (mon.0) 451 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.308 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.344964+0000 mon.a (mon.0) 452 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.308 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.345137+0000 mon.a (mon.0) 453 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.308 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.744610+0000 mon.a (mon.0) 454 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-07-20T15:02:46.308 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.744710+0000 mon.a (mon.0) 455 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-07-20T15:02:46.308 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.744950+0000 mon.a (mon.0) 456 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.309 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.745119+0000 mon.a (mon.0) 457 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.309 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.745607+0000 mon.a (mon.0) 458 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.309 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.745779+0000 mon.a (mon.0) 459 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.309 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.745998+0000 mon.a (mon.0) 460 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.309 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.746217+0000 mon.a (mon.0) 461 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.309 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[104918]: cluster 2023-07-20T15:02:45.803077+0000 mgr.y (mgr.14142) 101 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:46.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.143404+0000 mon.a (mon.0) 438 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-07-20T15:02:46.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.143453+0000 mon.a (mon.0) 439 : cluster [INF] osd.4 failed (root=default,host=smithi178) (connection refused reported by osd.2) 2023-07-20T15:02:46.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.143590+0000 mon.a (mon.0) 440 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.143642+0000 mon.a (mon.0) 441 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.143791+0000 mon.a (mon.0) 442 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.143847+0000 mon.a (mon.0) 443 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.144023+0000 mon.a (mon.0) 444 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.144108+0000 mon.a (mon.0) 445 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.343972+0000 mon.a (mon.0) 446 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.344207+0000 mon.a (mon.0) 447 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-07-20T15:02:46.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.344362+0000 mon.a (mon.0) 448 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.344518+0000 mon.a (mon.0) 449 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-07-20T15:02:46.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.344635+0000 mon.a (mon.0) 450 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.344715+0000 mon.a (mon.0) 451 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.344964+0000 mon.a (mon.0) 452 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.345137+0000 mon.a (mon.0) 453 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.744610+0000 mon.a (mon.0) 454 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-07-20T15:02:46.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.744710+0000 mon.a (mon.0) 455 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-07-20T15:02:46.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.744950+0000 mon.a (mon.0) 456 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.745119+0000 mon.a (mon.0) 457 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.745607+0000 mon.a (mon.0) 458 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.460 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.745779+0000 mon.a (mon.0) 459 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.468 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.745998+0000 mon.a (mon.0) 460 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.479 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.746217+0000 mon.a (mon.0) 461 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.479 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[104935]: cluster 2023-07-20T15:02:45.803077+0000 mgr.y (mgr.14142) 101 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:46.480 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.143404+0000 mon.a (mon.0) 438 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-07-20T15:02:46.480 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.143453+0000 mon.a (mon.0) 439 : cluster [INF] osd.4 failed (root=default,host=smithi178) (connection refused reported by osd.2) 2023-07-20T15:02:46.480 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.143590+0000 mon.a (mon.0) 440 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.480 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.143642+0000 mon.a (mon.0) 441 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.480 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.143791+0000 mon.a (mon.0) 442 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.481 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.143847+0000 mon.a (mon.0) 443 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.501 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.144023+0000 mon.a (mon.0) 444 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.502 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.144108+0000 mon.a (mon.0) 445 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.502 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.343972+0000 mon.a (mon.0) 446 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.502 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.344207+0000 mon.a (mon.0) 447 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-07-20T15:02:46.502 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.344362+0000 mon.a (mon.0) 448 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.503 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.344518+0000 mon.a (mon.0) 449 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-07-20T15:02:46.503 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.344635+0000 mon.a (mon.0) 450 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.503 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.344715+0000 mon.a (mon.0) 451 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.503 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.344964+0000 mon.a (mon.0) 452 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.503 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.345137+0000 mon.a (mon.0) 453 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.503 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.744610+0000 mon.a (mon.0) 454 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-07-20T15:02:46.503 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.744710+0000 mon.a (mon.0) 455 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-07-20T15:02:46.504 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.744950+0000 mon.a (mon.0) 456 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.504 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.745119+0000 mon.a (mon.0) 457 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-07-20T15:02:46.504 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.745607+0000 mon.a (mon.0) 458 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.504 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.745779+0000 mon.a (mon.0) 459 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-07-20T15:02:46.504 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.745998+0000 mon.a (mon.0) 460 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.505 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.746217+0000 mon.a (mon.0) 461 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-07-20T15:02:46.505 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:46 smithi029 bash[108361]: cluster 2023-07-20T15:02:45.803077+0000 mgr.y (mgr.14142) 101 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:46.589 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:46 smithi178 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.4.service: Succeeded. 2023-07-20T15:02:46.590 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:46 smithi178 systemd[1]: Stopped Ceph osd.4 for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:02:46.590 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:46 smithi178 systemd[1]: Starting Ceph osd.4 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:02:46.590 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:46 smithi178 podman[108728]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.4" found: no such container 2023-07-20T15:02:46.590 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:46 smithi178 systemd[1]: Started Ceph osd.4 for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:02:47.309 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[108745]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-20T15:02:47.310 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[108745]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2023-07-20T15:02:47.310 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[108745]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2023-07-20T15:02:47.310 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[108745]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2023-07-20T15:02:47.322 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[108745]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-07-20T15:02:47.323 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[108745]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-20T15:02:47.323 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:46 smithi178 bash[108745]: --> ceph-volume lvm activate successful for osd ID: 4 2023-07-20T15:02:47.323 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:47 smithi178 bash[104918]: cluster 2023-07-20T15:02:46.040855+0000 mon.a (mon.0) 462 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:02:47.323 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:47 smithi178 bash[104918]: cluster 2023-07-20T15:02:46.040882+0000 mon.a (mon.0) 463 : cluster [WRN] Health check failed: 1 host (1 osds) down (OSD_HOST_DOWN) 2023-07-20T15:02:47.324 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:47 smithi178 bash[104918]: cluster 2023-07-20T15:02:46.049545+0000 mon.a (mon.0) 464 : cluster [DBG] osdmap e38: 6 total, 4 up, 5 in 2023-07-20T15:02:47.324 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:47 smithi178 bash[104918]: audit 2023-07-20T15:02:46.049776+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:47.324 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:47 smithi178 bash[104918]: audit 2023-07-20T15:02:46.437171+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}}, \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:47.324 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:47 smithi178 bash[104918]: audit 2023-07-20T15:02:46.437638+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:47.324 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:47 smithi178 bash[104918]: audit 2023-07-20T15:02:46.441168+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}}, \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:47.324 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:47 smithi178 bash[104918]: audit 2023-07-20T15:02:46.442137+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-20T15:02:47.325 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:47 smithi178 bash[104918]: audit 2023-07-20T15:02:46.443335+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:47.325 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:47 smithi178 bash[104918]: cephadm 2023-07-20T15:02:46.443975+0000 mgr.y (mgr.14142) 102 : cephadm [INF] Deploying daemon osd.5 on smithi178 2023-07-20T15:02:47.325 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:47 smithi178 bash[104918]: audit 2023-07-20T15:02:46.444277+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2023-07-20T15:02:47.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[104935]: cluster 2023-07-20T15:02:46.040855+0000 mon.a (mon.0) 462 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:02:47.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[104935]: cluster 2023-07-20T15:02:46.040882+0000 mon.a (mon.0) 463 : cluster [WRN] Health check failed: 1 host (1 osds) down (OSD_HOST_DOWN) 2023-07-20T15:02:47.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[104935]: cluster 2023-07-20T15:02:46.049545+0000 mon.a (mon.0) 464 : cluster [DBG] osdmap e38: 6 total, 4 up, 5 in 2023-07-20T15:02:47.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[104935]: audit 2023-07-20T15:02:46.049776+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:47.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[108361]: cluster 2023-07-20T15:02:46.040855+0000 mon.a (mon.0) 462 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:02:47.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[108361]: cluster 2023-07-20T15:02:46.040882+0000 mon.a (mon.0) 463 : cluster [WRN] Health check failed: 1 host (1 osds) down (OSD_HOST_DOWN) 2023-07-20T15:02:47.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[108361]: cluster 2023-07-20T15:02:46.049545+0000 mon.a (mon.0) 464 : cluster [DBG] osdmap e38: 6 total, 4 up, 5 in 2023-07-20T15:02:47.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[108361]: audit 2023-07-20T15:02:46.049776+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:47.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[104935]: audit 2023-07-20T15:02:46.437171+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}}, \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:47.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[104935]: audit 2023-07-20T15:02:46.437638+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:47.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[108361]: audit 2023-07-20T15:02:46.437171+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}}, \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:47.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[108361]: audit 2023-07-20T15:02:46.437638+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:47.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[104935]: audit 2023-07-20T15:02:46.441168+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}}, \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:47.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[104935]: audit 2023-07-20T15:02:46.442137+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-20T15:02:47.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[104935]: audit 2023-07-20T15:02:46.443335+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:47.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[104935]: cephadm 2023-07-20T15:02:46.443975+0000 mgr.y (mgr.14142) 102 : cephadm [INF] Deploying daemon osd.5 on smithi178 2023-07-20T15:02:47.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[104935]: audit 2023-07-20T15:02:46.444277+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2023-07-20T15:02:47.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[108361]: audit 2023-07-20T15:02:46.441168+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543460\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:34.543555\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}}, \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:47.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[108361]: audit 2023-07-20T15:02:46.442137+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-20T15:02:47.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[108361]: audit 2023-07-20T15:02:46.443335+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:47.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[108361]: cephadm 2023-07-20T15:02:46.443975+0000 mgr.y (mgr.14142) 102 : cephadm [INF] Deploying daemon osd.5 on smithi178 2023-07-20T15:02:47.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:47 smithi029 bash[108361]: audit 2023-07-20T15:02:46.444277+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2023-07-20T15:02:48.191 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 4,5 on host 'smithi178' 2023-07-20T15:02:48.349 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:48 smithi178 bash[104918]: cluster 2023-07-20T15:02:47.051541+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e39: 6 total, 4 up, 5 in 2023-07-20T15:02:48.349 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:48 smithi178 bash[104918]: audit 2023-07-20T15:02:47.051893+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:48.349 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:48 smithi178 bash[104918]: audit 2023-07-20T15:02:47.537036+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536184\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536295\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536336\", \"created\": \"2023-07-20T15:02:32.970008\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}}, \"last_daemon_update\": \"2023-07-20T15:02:47.536419\", \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:48.350 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:48 smithi178 bash[104918]: audit 2023-07-20T15:02:47.541054+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536184\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536295\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536336\", \"created\": \"2023-07-20T15:02:32.970008\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}}, \"last_daemon_update\": \"2023-07-20T15:02:47.536419\", \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:48.350 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:48 smithi178 bash[104918]: cluster 2023-07-20T15:02:47.803523+0000 mgr.y (mgr.14142) 103 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:48.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:48 smithi029 bash[104935]: cluster 2023-07-20T15:02:47.051541+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e39: 6 total, 4 up, 5 in 2023-07-20T15:02:48.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:48 smithi029 bash[104935]: audit 2023-07-20T15:02:47.051893+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:48.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:48 smithi029 bash[108361]: cluster 2023-07-20T15:02:47.051541+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e39: 6 total, 4 up, 5 in 2023-07-20T15:02:48.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:48 smithi029 bash[108361]: audit 2023-07-20T15:02:47.051893+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:48.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:48 smithi029 bash[104935]: audit 2023-07-20T15:02:47.537036+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536184\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536295\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536336\", \"created\": \"2023-07-20T15:02:32.970008\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}}, \"last_daemon_update\": \"2023-07-20T15:02:47.536419\", \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:48.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:48 smithi029 bash[108361]: audit 2023-07-20T15:02:47.537036+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536184\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536295\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536336\", \"created\": \"2023-07-20T15:02:32.970008\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}}, \"last_daemon_update\": \"2023-07-20T15:02:47.536419\", \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:48.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:48 smithi029 bash[104935]: audit 2023-07-20T15:02:47.541054+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536184\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536295\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536336\", \"created\": \"2023-07-20T15:02:32.970008\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}}, \"last_daemon_update\": \"2023-07-20T15:02:47.536419\", \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:48.459 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:48 smithi029 bash[104935]: cluster 2023-07-20T15:02:47.803523+0000 mgr.y (mgr.14142) 103 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:48.460 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:48 smithi029 bash[108361]: audit 2023-07-20T15:02:47.541054+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536184\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536295\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536336\", \"created\": \"2023-07-20T15:02:32.970008\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}}, \"last_daemon_update\": \"2023-07-20T15:02:47.536419\", \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:48.460 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:48 smithi029 bash[108361]: cluster 2023-07-20T15:02:47.803523+0000 mgr.y (mgr.14142) 103 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:02:48.668 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:48 smithi178 bash[108998]: debug 2023-07-20T15:02:48.420+0000 7f43ed421ec0 -1 Falling back to public interface 2023-07-20T15:02:48.750 DEBUG:teuthology.orchestra.run.smithi178:osd.5> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.5.service 2023-07-20T15:02:48.782 INFO:tasks.cephadm:Deploying osd.6 on smithi178 with /dev/vg_nvme/lv_2... 2023-07-20T15:02:48.783 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-07-20T15:02:48.831 INFO:journalctl@ceph.osd.5.smithi178.stdout:-- Logs begin at Thu 2023-07-20 14:49:59 UTC. -- 2023-07-20T15:02:49.024 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:02:48 smithi178 bash[109131]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-20T15:02:49.024 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:02:48 smithi178 bash[109131]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2023-07-20T15:02:49.024 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:02:48 smithi178 bash[109131]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2023-07-20T15:02:49.024 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:02:48 smithi178 bash[109131]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2023-07-20T15:02:49.024 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:02:48 smithi178 bash[109131]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-07-20T15:02:49.025 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:02:48 smithi178 bash[109131]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-20T15:02:49.025 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:02:48 smithi178 bash[109131]: --> ceph-volume lvm activate successful for osd ID: 5 2023-07-20T15:02:49.329 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:48 smithi178 bash[108998]: debug 2023-07-20T15:02:48.978+0000 7f43ed421ec0 -1 osd.4 37 log_to_monitors {default=true} 2023-07-20T15:02:49.329 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:02:48 smithi178 bash[108998]: debug 2023-07-20T15:02:48.986+0000 7f43e13f2700 -1 osd.4 37 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2023-07-20T15:02:49.330 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:49 smithi178 bash[104918]: audit 2023-07-20T15:02:48.141231+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536184\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536295\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536336\", \"created\": \"2023-07-20T15:02:32.970008\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:49.342 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:49 smithi178 bash[104918]: audit 2023-07-20T15:02:48.141660+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:49.346 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:49 smithi178 bash[104918]: audit 2023-07-20T15:02:48.144059+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536184\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536295\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536336\", \"created\": \"2023-07-20T15:02:32.970008\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:49.346 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:49 smithi178 bash[104918]: audit 2023-07-20T15:02:48.982773+0000 mon.b (mon.2) 11 : audit [INF] from='osd.4 [v2:172.21.15.178:6800/915448555,v1:172.21.15.178:6801/915448555]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-20T15:02:49.346 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:49 smithi178 bash[104918]: audit 2023-07-20T15:02:48.983218+0000 mon.a (mon.0) 479 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-20T15:02:49.346 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:49 smithi178 bash[104918]: audit 2023-07-20T15:02:48.983902+0000 mon.b (mon.2) 12 : audit [INF] from='osd.4 [v2:172.21.15.178:6800/915448555,v1:172.21.15.178:6801/915448555]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:49.347 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:49 smithi178 bash[104918]: audit 2023-07-20T15:02:48.984336+0000 mon.a (mon.0) 480 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:49.462 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:49 smithi029 bash[104935]: audit 2023-07-20T15:02:48.141231+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536184\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536295\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536336\", \"created\": \"2023-07-20T15:02:32.970008\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:49.466 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:49 smithi029 bash[104935]: audit 2023-07-20T15:02:48.141660+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:49.467 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:49 smithi029 bash[108361]: audit 2023-07-20T15:02:48.141231+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536184\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536295\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536336\", \"created\": \"2023-07-20T15:02:32.970008\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:49.467 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:49 smithi029 bash[108361]: audit 2023-07-20T15:02:48.141660+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:49.467 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:49 smithi029 bash[104935]: audit 2023-07-20T15:02:48.144059+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536184\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536295\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536336\", \"created\": \"2023-07-20T15:02:32.970008\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:49.468 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:49 smithi029 bash[104935]: audit 2023-07-20T15:02:48.982773+0000 mon.b (mon.2) 11 : audit [INF] from='osd.4 [v2:172.21.15.178:6800/915448555,v1:172.21.15.178:6801/915448555]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-20T15:02:49.468 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:49 smithi029 bash[104935]: audit 2023-07-20T15:02:48.983218+0000 mon.a (mon.0) 479 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-20T15:02:49.483 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:49 smithi029 bash[104935]: audit 2023-07-20T15:02:48.983902+0000 mon.b (mon.2) 12 : audit [INF] from='osd.4 [v2:172.21.15.178:6800/915448555,v1:172.21.15.178:6801/915448555]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:49.483 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:49 smithi029 bash[104935]: audit 2023-07-20T15:02:48.984336+0000 mon.a (mon.0) 480 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:49.483 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:49 smithi029 bash[108361]: audit 2023-07-20T15:02:48.144059+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536184\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536295\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:47.536336\", \"created\": \"2023-07-20T15:02:32.970008\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_device_update\": \"2023-07-20T15:02:37.094946\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:49.489 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:49 smithi029 bash[108361]: audit 2023-07-20T15:02:48.982773+0000 mon.b (mon.2) 11 : audit [INF] from='osd.4 [v2:172.21.15.178:6800/915448555,v1:172.21.15.178:6801/915448555]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-20T15:02:49.489 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:49 smithi029 bash[108361]: audit 2023-07-20T15:02:48.983218+0000 mon.a (mon.0) 479 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-20T15:02:49.490 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:49 smithi029 bash[108361]: audit 2023-07-20T15:02:48.983902+0000 mon.b (mon.2) 12 : audit [INF] from='osd.4 [v2:172.21.15.178:6800/915448555,v1:172.21.15.178:6801/915448555]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:49.490 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:49 smithi029 bash[108361]: audit 2023-07-20T15:02:48.984336+0000 mon.a (mon.0) 480 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:50.405 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:50 smithi178 bash[104918]: cluster 2023-07-20T15:02:49.539726+0000 mon.a (mon.0) 481 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:02:50.405 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:50 smithi178 bash[104918]: cluster 2023-07-20T15:02:49.539763+0000 mon.a (mon.0) 482 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (1 osds) down) 2023-07-20T15:02:50.405 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:50 smithi178 bash[104918]: cluster 2023-07-20T15:02:49.539786+0000 mon.a (mon.0) 483 : cluster [INF] Cluster is now healthy 2023-07-20T15:02:50.405 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:50 smithi178 bash[104918]: cluster 2023-07-20T15:02:49.544433+0000 mon.a (mon.0) 484 : cluster [INF] osd.4 [v2:172.21.15.178:6800/915448555,v1:172.21.15.178:6801/915448555] boot 2023-07-20T15:02:50.406 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:50 smithi178 bash[104918]: cluster 2023-07-20T15:02:49.544505+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e40: 6 total, 5 up, 5 in 2023-07-20T15:02:50.406 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:50 smithi178 bash[104918]: audit 2023-07-20T15:02:49.544691+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:50.406 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:50 smithi178 bash[104918]: audit 2023-07-20T15:02:49.545166+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:50.406 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:50 smithi178 bash[104918]: cluster 2023-07-20T15:02:49.803859+0000 mgr.y (mgr.14142) 104 : cluster [DBG] pgmap v105: 1 pgs: 1 active+undersized+degraded; 0 B data, 1.6 MiB used, 442 GiB / 447 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:02:50.406 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:50 smithi178 bash[104918]: audit 2023-07-20T15:02:49.970812+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"7e2915c2233f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970065\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:02:49.476689\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_daemon_update\": \"2023-07-20T15:02:49.970160\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:50.406 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:50 smithi178 bash[104918]: audit 2023-07-20T15:02:49.974831+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"7e2915c2233f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970065\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:02:49.476689\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_daemon_update\": \"2023-07-20T15:02:49.970160\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:50.406 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:50 smithi178 bash[104918]: audit 2023-07-20T15:02:49.975580+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:50.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[104935]: cluster 2023-07-20T15:02:49.539726+0000 mon.a (mon.0) 481 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:02:50.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[104935]: cluster 2023-07-20T15:02:49.539763+0000 mon.a (mon.0) 482 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (1 osds) down) 2023-07-20T15:02:50.460 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[104935]: cluster 2023-07-20T15:02:49.539786+0000 mon.a (mon.0) 483 : cluster [INF] Cluster is now healthy 2023-07-20T15:02:50.460 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[104935]: cluster 2023-07-20T15:02:49.544433+0000 mon.a (mon.0) 484 : cluster [INF] osd.4 [v2:172.21.15.178:6800/915448555,v1:172.21.15.178:6801/915448555] boot 2023-07-20T15:02:50.460 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[104935]: cluster 2023-07-20T15:02:49.544505+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e40: 6 total, 5 up, 5 in 2023-07-20T15:02:50.460 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[104935]: audit 2023-07-20T15:02:49.544691+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:50.461 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[104935]: audit 2023-07-20T15:02:49.545166+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:50.461 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[104935]: cluster 2023-07-20T15:02:49.803859+0000 mgr.y (mgr.14142) 104 : cluster [DBG] pgmap v105: 1 pgs: 1 active+undersized+degraded; 0 B data, 1.6 MiB used, 442 GiB / 447 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:02:50.461 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[108361]: cluster 2023-07-20T15:02:49.539726+0000 mon.a (mon.0) 481 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:02:50.461 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[108361]: cluster 2023-07-20T15:02:49.539763+0000 mon.a (mon.0) 482 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (1 osds) down) 2023-07-20T15:02:50.461 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[108361]: cluster 2023-07-20T15:02:49.539786+0000 mon.a (mon.0) 483 : cluster [INF] Cluster is now healthy 2023-07-20T15:02:50.462 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[108361]: cluster 2023-07-20T15:02:49.544433+0000 mon.a (mon.0) 484 : cluster [INF] osd.4 [v2:172.21.15.178:6800/915448555,v1:172.21.15.178:6801/915448555] boot 2023-07-20T15:02:50.462 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[108361]: cluster 2023-07-20T15:02:49.544505+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e40: 6 total, 5 up, 5 in 2023-07-20T15:02:50.462 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[108361]: audit 2023-07-20T15:02:49.544691+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:02:50.462 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[108361]: audit 2023-07-20T15:02:49.545166+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:50.462 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[108361]: cluster 2023-07-20T15:02:49.803859+0000 mgr.y (mgr.14142) 104 : cluster [DBG] pgmap v105: 1 pgs: 1 active+undersized+degraded; 0 B data, 1.6 MiB used, 442 GiB / 447 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:02:50.463 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[104935]: audit 2023-07-20T15:02:49.970812+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"7e2915c2233f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970065\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:02:49.476689\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_daemon_update\": \"2023-07-20T15:02:49.970160\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:50.463 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[108361]: audit 2023-07-20T15:02:49.970812+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"7e2915c2233f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970065\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:02:49.476689\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_daemon_update\": \"2023-07-20T15:02:49.970160\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:50.463 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[104935]: audit 2023-07-20T15:02:49.974831+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"7e2915c2233f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970065\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:02:49.476689\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_daemon_update\": \"2023-07-20T15:02:49.970160\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:50.464 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[104935]: audit 2023-07-20T15:02:49.975580+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:50.464 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[108361]: audit 2023-07-20T15:02:49.974831+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"7e2915c2233f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970065\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:02:49.476689\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_daemon_update\": \"2023-07-20T15:02:49.970160\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:50.474 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:50 smithi029 bash[108361]: audit 2023-07-20T15:02:49.975580+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:50.612 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-07-20T15:02:50.612 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-07-20T15:02:50.612 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2023-07-20T15:02:50.613 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2023-07-20T15:02:50.613 INFO:teuthology.orchestra.run.smithi178.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00959766 s, 1.1 GB/s 2023-07-20T15:02:50.613 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2023-07-20T15:02:50.657 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:02:50 smithi178 bash[109508]: debug 2023-07-20T15:02:50.452+0000 7f70cddb1ec0 -1 Falling back to public interface 2023-07-20T15:02:51.300 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:02:51 smithi178 bash[109508]: debug 2023-07-20T15:02:51.023+0000 7f70cddb1ec0 -1 osd.5 0 log_to_monitors {default=true} 2023-07-20T15:02:51.341 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi178:vg_nvme/lv_2 2023-07-20T15:02:51.918 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:51 smithi178 bash[104918]: cluster 2023-07-20T15:02:50.545922+0000 mon.a (mon.0) 491 : cluster [DBG] osdmap e41: 6 total, 5 up, 5 in 2023-07-20T15:02:51.919 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:51 smithi178 bash[104918]: audit 2023-07-20T15:02:50.546113+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:51.919 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:51 smithi178 bash[104918]: cluster 2023-07-20T15:02:50.801828+0000 mon.a (mon.0) 493 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-07-20T15:02:51.919 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:51 smithi178 bash[104918]: audit 2023-07-20T15:02:51.027634+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.15.178:6808/3062199323,v1:172.21.15.178:6809/3062199323]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-20T15:02:51.919 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:51 smithi178 bash[104918]: audit 2023-07-20T15:02:51.028165+0000 mon.a (mon.0) 494 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-20T15:02:51.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:51 smithi029 bash[104935]: cluster 2023-07-20T15:02:50.545922+0000 mon.a (mon.0) 491 : cluster [DBG] osdmap e41: 6 total, 5 up, 5 in 2023-07-20T15:02:51.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:51 smithi029 bash[104935]: audit 2023-07-20T15:02:50.546113+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:51.951 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:51 smithi029 bash[104935]: cluster 2023-07-20T15:02:50.801828+0000 mon.a (mon.0) 493 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-07-20T15:02:51.951 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:51 smithi029 bash[104935]: audit 2023-07-20T15:02:51.027634+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.15.178:6808/3062199323,v1:172.21.15.178:6809/3062199323]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-20T15:02:51.951 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:51 smithi029 bash[104935]: audit 2023-07-20T15:02:51.028165+0000 mon.a (mon.0) 494 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-20T15:02:51.951 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:51 smithi029 bash[108361]: cluster 2023-07-20T15:02:50.545922+0000 mon.a (mon.0) 491 : cluster [DBG] osdmap e41: 6 total, 5 up, 5 in 2023-07-20T15:02:51.952 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:51 smithi029 bash[108361]: audit 2023-07-20T15:02:50.546113+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:51.952 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:51 smithi029 bash[108361]: cluster 2023-07-20T15:02:50.801828+0000 mon.a (mon.0) 493 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-07-20T15:02:51.958 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:51 smithi029 bash[108361]: audit 2023-07-20T15:02:51.027634+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.15.178:6808/3062199323,v1:172.21.15.178:6809/3062199323]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-20T15:02:51.959 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:51 smithi029 bash[108361]: audit 2023-07-20T15:02:51.028165+0000 mon.a (mon.0) 494 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-20T15:02:53.153 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:02:52 smithi178 bash[109508]: debug 2023-07-20T15:02:52.810+0000 7f70b6b66700 -1 osd.5 0 waiting for initial osdmap 2023-07-20T15:02:53.153 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:02:52 smithi178 bash[109508]: debug 2023-07-20T15:02:52.821+0000 7f70c1d82700 -1 osd.5 43 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2023-07-20T15:02:53.154 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:52 smithi178 bash[104918]: cluster 2023-07-20T15:02:51.804191+0000 mgr.y (mgr.14142) 105 : cluster [DBG] pgmap v107: 1 pgs: 1 active+undersized+degraded; 0 B data, 1.6 MiB used, 442 GiB / 447 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:02:53.154 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:52 smithi178 bash[104918]: audit 2023-07-20T15:02:51.807581+0000 mon.a (mon.0) 495 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-07-20T15:02:53.154 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:52 smithi178 bash[104918]: cluster 2023-07-20T15:02:51.807650+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e42: 6 total, 5 up, 5 in 2023-07-20T15:02:53.154 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:52 smithi178 bash[104918]: audit 2023-07-20T15:02:51.807807+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:53.154 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:52 smithi178 bash[104918]: audit 2023-07-20T15:02:51.808102+0000 mon.b (mon.2) 14 : audit [INF] from='osd.5 [v2:172.21.15.178:6808/3062199323,v1:172.21.15.178:6809/3062199323]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:53.154 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:52 smithi178 bash[104918]: audit 2023-07-20T15:02:51.808373+0000 mon.a (mon.0) 498 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:53.154 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:52 smithi178 bash[104918]: audit 2023-07-20T15:02:52.629236+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:02:53.155 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:52 smithi178 bash[104918]: audit 2023-07-20T15:02:52.630056+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:53.155 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:52 smithi178 bash[104918]: audit 2023-07-20T15:02:52.631224+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:53.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[104935]: cluster 2023-07-20T15:02:51.804191+0000 mgr.y (mgr.14142) 105 : cluster [DBG] pgmap v107: 1 pgs: 1 active+undersized+degraded; 0 B data, 1.6 MiB used, 442 GiB / 447 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:02:53.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[104935]: audit 2023-07-20T15:02:51.807581+0000 mon.a (mon.0) 495 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-07-20T15:02:53.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[104935]: cluster 2023-07-20T15:02:51.807650+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e42: 6 total, 5 up, 5 in 2023-07-20T15:02:53.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[104935]: audit 2023-07-20T15:02:51.807807+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:53.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[104935]: audit 2023-07-20T15:02:51.808102+0000 mon.b (mon.2) 14 : audit [INF] from='osd.5 [v2:172.21.15.178:6808/3062199323,v1:172.21.15.178:6809/3062199323]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:53.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[104935]: audit 2023-07-20T15:02:51.808373+0000 mon.a (mon.0) 498 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:53.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[104935]: audit 2023-07-20T15:02:52.629236+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:02:53.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[104935]: audit 2023-07-20T15:02:52.630056+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:53.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[104935]: audit 2023-07-20T15:02:52.631224+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:53.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[108361]: cluster 2023-07-20T15:02:51.804191+0000 mgr.y (mgr.14142) 105 : cluster [DBG] pgmap v107: 1 pgs: 1 active+undersized+degraded; 0 B data, 1.6 MiB used, 442 GiB / 447 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:02:53.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[108361]: audit 2023-07-20T15:02:51.807581+0000 mon.a (mon.0) 495 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-07-20T15:02:53.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[108361]: cluster 2023-07-20T15:02:51.807650+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e42: 6 total, 5 up, 5 in 2023-07-20T15:02:53.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[108361]: audit 2023-07-20T15:02:51.807807+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:53.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[108361]: audit 2023-07-20T15:02:51.808102+0000 mon.b (mon.2) 14 : audit [INF] from='osd.5 [v2:172.21.15.178:6808/3062199323,v1:172.21.15.178:6809/3062199323]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:53.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[108361]: audit 2023-07-20T15:02:51.808373+0000 mon.a (mon.0) 498 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:02:53.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[108361]: audit 2023-07-20T15:02:52.629236+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:02:53.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[108361]: audit 2023-07-20T15:02:52.630056+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:02:53.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:52 smithi029 bash[108361]: audit 2023-07-20T15:02:52.631224+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:54.177 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:53 smithi178 bash[104918]: cluster 2023-07-20T15:02:52.041830+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:02:54.177 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:53 smithi178 bash[104918]: cluster 2023-07-20T15:02:52.041870+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:02:54.178 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:53 smithi178 bash[104918]: audit 2023-07-20T15:02:52.628082+0000 mgr.y (mgr.14142) 106 : audit [DBG] from='client.34265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:02:54.178 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:53 smithi178 bash[104918]: cephadm 2023-07-20T15:02:52.628928+0000 mgr.y (mgr.14142) 107 : cephadm [INF] Applying osd on host smithi178... 2023-07-20T15:02:54.178 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:53 smithi178 bash[104918]: audit 2023-07-20T15:02:52.809435+0000 mon.a (mon.0) 502 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-07-20T15:02:54.178 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:53 smithi178 bash[104918]: cluster 2023-07-20T15:02:52.809496+0000 mon.a (mon.0) 503 : cluster [DBG] osdmap e43: 6 total, 5 up, 5 in 2023-07-20T15:02:54.178 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:53 smithi178 bash[104918]: audit 2023-07-20T15:02:52.810140+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:54.178 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:53 smithi178 bash[104918]: audit 2023-07-20T15:02:52.974590+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:54.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:53 smithi178 bash[104918]: audit 2023-07-20T15:02:53.169338+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"7e2915c2233f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970065\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:02:49.476689\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_daemon_update\": \"2023-07-20T15:02:49.970160\", \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:54.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:53 smithi178 bash[104918]: audit 2023-07-20T15:02:53.172597+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"7e2915c2233f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970065\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:02:49.476689\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_daemon_update\": \"2023-07-20T15:02:49.970160\", \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:54.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[104935]: cluster 2023-07-20T15:02:52.041830+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:02:54.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[104935]: cluster 2023-07-20T15:02:52.041870+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:02:54.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[104935]: audit 2023-07-20T15:02:52.628082+0000 mgr.y (mgr.14142) 106 : audit [DBG] from='client.34265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:02:54.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[104935]: cephadm 2023-07-20T15:02:52.628928+0000 mgr.y (mgr.14142) 107 : cephadm [INF] Applying osd on host smithi178... 2023-07-20T15:02:54.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[104935]: audit 2023-07-20T15:02:52.809435+0000 mon.a (mon.0) 502 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-07-20T15:02:54.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[104935]: cluster 2023-07-20T15:02:52.809496+0000 mon.a (mon.0) 503 : cluster [DBG] osdmap e43: 6 total, 5 up, 5 in 2023-07-20T15:02:54.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[104935]: audit 2023-07-20T15:02:52.810140+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:54.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[104935]: audit 2023-07-20T15:02:52.974590+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:54.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[108361]: cluster 2023-07-20T15:02:52.041830+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:02:54.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[108361]: cluster 2023-07-20T15:02:52.041870+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:02:54.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[108361]: audit 2023-07-20T15:02:52.628082+0000 mgr.y (mgr.14142) 106 : audit [DBG] from='client.34265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:02:54.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[108361]: cephadm 2023-07-20T15:02:52.628928+0000 mgr.y (mgr.14142) 107 : cephadm [INF] Applying osd on host smithi178... 2023-07-20T15:02:54.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[108361]: audit 2023-07-20T15:02:52.809435+0000 mon.a (mon.0) 502 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-07-20T15:02:54.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[108361]: cluster 2023-07-20T15:02:52.809496+0000 mon.a (mon.0) 503 : cluster [DBG] osdmap e43: 6 total, 5 up, 5 in 2023-07-20T15:02:54.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[108361]: audit 2023-07-20T15:02:52.810140+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:54.226 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[108361]: audit 2023-07-20T15:02:52.974590+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:02:54.227 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[104935]: audit 2023-07-20T15:02:53.169338+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"7e2915c2233f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970065\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:02:49.476689\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_daemon_update\": \"2023-07-20T15:02:49.970160\", \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:54.227 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[104935]: audit 2023-07-20T15:02:53.172597+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"7e2915c2233f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970065\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:02:49.476689\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_daemon_update\": \"2023-07-20T15:02:49.970160\", \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:54.228 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[108361]: audit 2023-07-20T15:02:53.169338+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"7e2915c2233f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970065\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:02:49.476689\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_daemon_update\": \"2023-07-20T15:02:49.970160\", \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:02:54.232 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:53 smithi029 bash[108361]: audit 2023-07-20T15:02:53.172597+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"7e2915c2233f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970065\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:02:49.476689\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:46.441904\"}}, \"last_daemon_update\": \"2023-07-20T15:02:49.970160\", \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:02:55.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:54 smithi178 bash[104918]: cluster 2023-07-20T15:02:53.804485+0000 mgr.y (mgr.14142) 108 : cluster [DBG] pgmap v110: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 442 GiB / 447 GiB avail 2023-07-20T15:02:55.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:54 smithi178 bash[104918]: cluster 2023-07-20T15:02:53.810686+0000 mon.a (mon.0) 508 : cluster [INF] osd.5 [v2:172.21.15.178:6808/3062199323,v1:172.21.15.178:6809/3062199323] boot 2023-07-20T15:02:55.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:54 smithi178 bash[104918]: cluster 2023-07-20T15:02:53.810729+0000 mon.a (mon.0) 509 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2023-07-20T15:02:55.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:54 smithi178 bash[104918]: audit 2023-07-20T15:02:53.811005+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:55.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:54 smithi178 bash[104918]: cluster 2023-07-20T15:02:54.170695+0000 mon.a (mon.0) 511 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2023-07-20T15:02:55.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:54 smithi178 bash[104918]: cluster 2023-07-20T15:02:54.170750+0000 mon.a (mon.0) 512 : cluster [INF] Cluster is now healthy 2023-07-20T15:02:55.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:54 smithi178 bash[104918]: audit 2023-07-20T15:02:54.303807+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.15.178:0/2333694598' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a34c575-fbe7-465c-9f28-cdd42b784e43"}]: dispatch 2023-07-20T15:02:55.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:54 smithi178 bash[104918]: audit 2023-07-20T15:02:54.304320+0000 mon.a (mon.0) 513 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a34c575-fbe7-465c-9f28-cdd42b784e43"}]: dispatch 2023-07-20T15:02:55.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:54 smithi178 bash[104918]: audit 2023-07-20T15:02:54.309372+0000 mon.a (mon.0) 514 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a34c575-fbe7-465c-9f28-cdd42b784e43"}]': finished 2023-07-20T15:02:55.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:54 smithi178 bash[104918]: cluster 2023-07-20T15:02:54.309433+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e45: 7 total, 6 up, 6 in 2023-07-20T15:02:55.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:54 smithi178 bash[104918]: audit 2023-07-20T15:02:54.309597+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:02:55.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[104935]: cluster 2023-07-20T15:02:53.804485+0000 mgr.y (mgr.14142) 108 : cluster [DBG] pgmap v110: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 442 GiB / 447 GiB avail 2023-07-20T15:02:55.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[104935]: cluster 2023-07-20T15:02:53.810686+0000 mon.a (mon.0) 508 : cluster [INF] osd.5 [v2:172.21.15.178:6808/3062199323,v1:172.21.15.178:6809/3062199323] boot 2023-07-20T15:02:55.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[104935]: cluster 2023-07-20T15:02:53.810729+0000 mon.a (mon.0) 509 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2023-07-20T15:02:55.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[104935]: audit 2023-07-20T15:02:53.811005+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:55.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[104935]: cluster 2023-07-20T15:02:54.170695+0000 mon.a (mon.0) 511 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2023-07-20T15:02:55.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[104935]: cluster 2023-07-20T15:02:54.170750+0000 mon.a (mon.0) 512 : cluster [INF] Cluster is now healthy 2023-07-20T15:02:55.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[104935]: audit 2023-07-20T15:02:54.303807+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.15.178:0/2333694598' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a34c575-fbe7-465c-9f28-cdd42b784e43"}]: dispatch 2023-07-20T15:02:55.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[104935]: audit 2023-07-20T15:02:54.304320+0000 mon.a (mon.0) 513 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a34c575-fbe7-465c-9f28-cdd42b784e43"}]: dispatch 2023-07-20T15:02:55.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[104935]: audit 2023-07-20T15:02:54.309372+0000 mon.a (mon.0) 514 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a34c575-fbe7-465c-9f28-cdd42b784e43"}]': finished 2023-07-20T15:02:55.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[104935]: cluster 2023-07-20T15:02:54.309433+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e45: 7 total, 6 up, 6 in 2023-07-20T15:02:55.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[104935]: audit 2023-07-20T15:02:54.309597+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:02:55.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[108361]: cluster 2023-07-20T15:02:53.804485+0000 mgr.y (mgr.14142) 108 : cluster [DBG] pgmap v110: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 442 GiB / 447 GiB avail 2023-07-20T15:02:55.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[108361]: cluster 2023-07-20T15:02:53.810686+0000 mon.a (mon.0) 508 : cluster [INF] osd.5 [v2:172.21.15.178:6808/3062199323,v1:172.21.15.178:6809/3062199323] boot 2023-07-20T15:02:55.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[108361]: cluster 2023-07-20T15:02:53.810729+0000 mon.a (mon.0) 509 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2023-07-20T15:02:55.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[108361]: audit 2023-07-20T15:02:53.811005+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:02:55.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[108361]: cluster 2023-07-20T15:02:54.170695+0000 mon.a (mon.0) 511 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2023-07-20T15:02:55.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[108361]: cluster 2023-07-20T15:02:54.170750+0000 mon.a (mon.0) 512 : cluster [INF] Cluster is now healthy 2023-07-20T15:02:55.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[108361]: audit 2023-07-20T15:02:54.303807+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.15.178:0/2333694598' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a34c575-fbe7-465c-9f28-cdd42b784e43"}]: dispatch 2023-07-20T15:02:55.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[108361]: audit 2023-07-20T15:02:54.304320+0000 mon.a (mon.0) 513 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a34c575-fbe7-465c-9f28-cdd42b784e43"}]: dispatch 2023-07-20T15:02:55.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[108361]: audit 2023-07-20T15:02:54.309372+0000 mon.a (mon.0) 514 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a34c575-fbe7-465c-9f28-cdd42b784e43"}]': finished 2023-07-20T15:02:55.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[108361]: cluster 2023-07-20T15:02:54.309433+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e45: 7 total, 6 up, 6 in 2023-07-20T15:02:55.209 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:54 smithi029 bash[108361]: audit 2023-07-20T15:02:54.309597+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:02:56.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:55 smithi178 bash[104918]: audit 2023-07-20T15:02:55.008690+0000 mon.b (mon.2) 16 : audit [DBG] from='client.? 172.21.15.178:0/1543883893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:02:56.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:55 smithi029 bash[104935]: audit 2023-07-20T15:02:55.008690+0000 mon.b (mon.2) 16 : audit [DBG] from='client.? 172.21.15.178:0/1543883893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:02:56.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:55 smithi029 bash[108361]: audit 2023-07-20T15:02:55.008690+0000 mon.b (mon.2) 16 : audit [DBG] from='client.? 172.21.15.178:0/1543883893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:02:57.126 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:56 smithi178 bash[104918]: cluster 2023-07-20T15:02:55.804901+0000 mgr.y (mgr.14142) 109 : cluster [DBG] pgmap v113: 1 pgs: 1 peering; 0 B data, 2.2 MiB used, 530 GiB / 536 GiB avail 2023-07-20T15:02:57.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:56 smithi029 bash[104935]: cluster 2023-07-20T15:02:55.804901+0000 mgr.y (mgr.14142) 109 : cluster [DBG] pgmap v113: 1 pgs: 1 peering; 0 B data, 2.2 MiB used, 530 GiB / 536 GiB avail 2023-07-20T15:02:57.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:56 smithi029 bash[108361]: cluster 2023-07-20T15:02:55.804901+0000 mgr.y (mgr.14142) 109 : cluster [DBG] pgmap v113: 1 pgs: 1 peering; 0 B data, 2.2 MiB used, 530 GiB / 536 GiB avail 2023-07-20T15:02:58.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:57 smithi178 bash[104918]: audit 2023-07-20T15:02:57.268256+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:58.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:57 smithi029 bash[104935]: audit 2023-07-20T15:02:57.268256+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:58.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:57 smithi029 bash[108361]: audit 2023-07-20T15:02:57.268256+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:02:59.185 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:58 smithi178 bash[104918]: cluster 2023-07-20T15:02:57.805377+0000 mgr.y (mgr.14142) 110 : cluster [DBG] pgmap v114: 1 pgs: 1 peering; 0 B data, 2.2 MiB used, 530 GiB / 536 GiB avail 2023-07-20T15:02:59.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:58 smithi029 bash[104935]: cluster 2023-07-20T15:02:57.805377+0000 mgr.y (mgr.14142) 110 : cluster [DBG] pgmap v114: 1 pgs: 1 peering; 0 B data, 2.2 MiB used, 530 GiB / 536 GiB avail 2023-07-20T15:02:59.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:58 smithi029 bash[108361]: cluster 2023-07-20T15:02:57.805377+0000 mgr.y (mgr.14142) 110 : cluster [DBG] pgmap v114: 1 pgs: 1 peering; 0 B data, 2.2 MiB used, 530 GiB / 536 GiB avail 2023-07-20T15:03:00.004 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:02:59 smithi178 systemd[1]: Stopping Ceph osd.5 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:03:00.004 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:59 smithi178 bash[104918]: audit 2023-07-20T15:02:58.923800+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-20T15:03:00.006 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:59 smithi178 bash[104918]: audit 2023-07-20T15:02:58.924593+0000 mon.a (mon.0) 519 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:00.006 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:02:59 smithi178 bash[104918]: audit 2023-07-20T15:02:58.925494+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2023-07-20T15:03:00.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:59 smithi029 bash[104935]: audit 2023-07-20T15:02:58.923800+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-20T15:03:00.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:59 smithi029 bash[104935]: audit 2023-07-20T15:02:58.924593+0000 mon.a (mon.0) 519 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:00.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:02:59 smithi029 bash[104935]: audit 2023-07-20T15:02:58.925494+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2023-07-20T15:03:00.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:59 smithi029 bash[108361]: audit 2023-07-20T15:02:58.923800+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-20T15:03:00.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:59 smithi029 bash[108361]: audit 2023-07-20T15:02:58.924593+0000 mon.a (mon.0) 519 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:00.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:02:59 smithi029 bash[108361]: audit 2023-07-20T15:02:58.925494+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2023-07-20T15:03:00.268 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:02:59 smithi178 bash[109508]: debug 2023-07-20T15:02:59.957+0000 7f70c55f9700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T15:03:00.268 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:02:59 smithi178 bash[109508]: debug 2023-07-20T15:02:59.957+0000 7f70c55f9700 -1 osd.5 45 *** Got signal Terminated *** 2023-07-20T15:03:00.269 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:02:59 smithi178 bash[109508]: debug 2023-07-20T15:02:59.957+0000 7f70c55f9700 -1 osd.5 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-20T15:03:00.669 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:00 smithi178 podman[110724]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.5 2023-07-20T15:03:01.112 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cephadm 2023-07-20T15:02:58.925163+0000 mgr.y (mgr.14142) 111 : cephadm [INF] Deploying daemon osd.5 on smithi178 2023-07-20T15:03:01.112 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:02:59.805675+0000 mgr.y (mgr.14142) 112 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 2.4 MiB used, 530 GiB / 536 GiB avail 2023-07-20T15:03:01.113 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:02:59.994696+0000 mon.a (mon.0) 521 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-07-20T15:03:01.113 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:02:59.994732+0000 mon.a (mon.0) 522 : cluster [INF] osd.5 failed (root=default,host=smithi178) (connection refused reported by osd.2) 2023-07-20T15:03:01.113 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:02:59.994880+0000 mon.a (mon.0) 523 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.113 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:02:59.994946+0000 mon.a (mon.0) 524 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.113 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:02:59.995077+0000 mon.a (mon.0) 525 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.113 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:02:59.995170+0000 mon.a (mon.0) 526 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.113 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.195631+0000 mon.a (mon.0) 527 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-07-20T15:03:01.114 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.195882+0000 mon.a (mon.0) 528 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-07-20T15:03:01.114 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.196018+0000 mon.a (mon.0) 529 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.114 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.196138+0000 mon.a (mon.0) 530 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-07-20T15:03:01.114 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.196250+0000 mon.a (mon.0) 531 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.114 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.196349+0000 mon.a (mon.0) 532 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-07-20T15:03:01.114 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.196524+0000 mon.a (mon.0) 533 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.114 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.196629+0000 mon.a (mon.0) 534 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-07-20T15:03:01.114 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.196719+0000 mon.a (mon.0) 535 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.115 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.196838+0000 mon.a (mon.0) 536 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-07-20T15:03:01.115 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.596264+0000 mon.a (mon.0) 537 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-07-20T15:03:01.115 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.596421+0000 mon.a (mon.0) 538 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-07-20T15:03:01.115 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.596657+0000 mon.a (mon.0) 539 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.117 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.596823+0000 mon.a (mon.0) 540 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-07-20T15:03:01.118 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.596974+0000 mon.a (mon.0) 541 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.118 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.597177+0000 mon.a (mon.0) 542 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-07-20T15:03:01.118 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.597343+0000 mon.a (mon.0) 543 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.119 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.597507+0000 mon.a (mon.0) 544 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-07-20T15:03:01.119 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.597665+0000 mon.a (mon.0) 545 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.119 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.597861+0000 mon.a (mon.0) 546 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-07-20T15:03:01.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cephadm 2023-07-20T15:02:58.925163+0000 mgr.y (mgr.14142) 111 : cephadm [INF] Deploying daemon osd.5 on smithi178 2023-07-20T15:03:01.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:02:59.805675+0000 mgr.y (mgr.14142) 112 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 2.4 MiB used, 530 GiB / 536 GiB avail 2023-07-20T15:03:01.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:02:59.994696+0000 mon.a (mon.0) 521 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-07-20T15:03:01.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:02:59.994732+0000 mon.a (mon.0) 522 : cluster [INF] osd.5 failed (root=default,host=smithi178) (connection refused reported by osd.2) 2023-07-20T15:03:01.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:02:59.994880+0000 mon.a (mon.0) 523 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:02:59.994946+0000 mon.a (mon.0) 524 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:02:59.995077+0000 mon.a (mon.0) 525 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:02:59.995170+0000 mon.a (mon.0) 526 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.195631+0000 mon.a (mon.0) 527 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-07-20T15:03:01.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.195882+0000 mon.a (mon.0) 528 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-07-20T15:03:01.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.196018+0000 mon.a (mon.0) 529 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.196138+0000 mon.a (mon.0) 530 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-07-20T15:03:01.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.196250+0000 mon.a (mon.0) 531 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.196349+0000 mon.a (mon.0) 532 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-07-20T15:03:01.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.196524+0000 mon.a (mon.0) 533 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.196629+0000 mon.a (mon.0) 534 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-07-20T15:03:01.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.196719+0000 mon.a (mon.0) 535 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.196838+0000 mon.a (mon.0) 536 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-07-20T15:03:01.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.596264+0000 mon.a (mon.0) 537 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-07-20T15:03:01.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.596421+0000 mon.a (mon.0) 538 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-07-20T15:03:01.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.596657+0000 mon.a (mon.0) 539 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.596823+0000 mon.a (mon.0) 540 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-07-20T15:03:01.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.596974+0000 mon.a (mon.0) 541 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.597177+0000 mon.a (mon.0) 542 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-07-20T15:03:01.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.597343+0000 mon.a (mon.0) 543 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.597507+0000 mon.a (mon.0) 544 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-07-20T15:03:01.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.597665+0000 mon.a (mon.0) 545 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.597861+0000 mon.a (mon.0) 546 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-07-20T15:03:01.211 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cephadm 2023-07-20T15:02:58.925163+0000 mgr.y (mgr.14142) 111 : cephadm [INF] Deploying daemon osd.5 on smithi178 2023-07-20T15:03:01.212 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:02:59.805675+0000 mgr.y (mgr.14142) 112 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 2.4 MiB used, 530 GiB / 536 GiB avail 2023-07-20T15:03:01.212 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:02:59.994696+0000 mon.a (mon.0) 521 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-07-20T15:03:01.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:02:59.994732+0000 mon.a (mon.0) 522 : cluster [INF] osd.5 failed (root=default,host=smithi178) (connection refused reported by osd.2) 2023-07-20T15:03:01.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:02:59.994880+0000 mon.a (mon.0) 523 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:02:59.994946+0000 mon.a (mon.0) 524 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.214 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:02:59.995077+0000 mon.a (mon.0) 525 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.214 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:02:59.995170+0000 mon.a (mon.0) 526 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.214 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.195631+0000 mon.a (mon.0) 527 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-07-20T15:03:01.214 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.195882+0000 mon.a (mon.0) 528 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-07-20T15:03:01.214 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.196018+0000 mon.a (mon.0) 529 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.214 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.196138+0000 mon.a (mon.0) 530 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-07-20T15:03:01.214 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.196250+0000 mon.a (mon.0) 531 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.215 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.196349+0000 mon.a (mon.0) 532 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-07-20T15:03:01.221 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.196524+0000 mon.a (mon.0) 533 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.221 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.196629+0000 mon.a (mon.0) 534 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-07-20T15:03:01.221 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.196719+0000 mon.a (mon.0) 535 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.222 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.196838+0000 mon.a (mon.0) 536 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-07-20T15:03:01.222 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.596264+0000 mon.a (mon.0) 537 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-07-20T15:03:01.222 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.596421+0000 mon.a (mon.0) 538 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-07-20T15:03:01.222 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.596657+0000 mon.a (mon.0) 539 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.223 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.596823+0000 mon.a (mon.0) 540 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-07-20T15:03:01.223 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.596974+0000 mon.a (mon.0) 541 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.223 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.597177+0000 mon.a (mon.0) 542 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-07-20T15:03:01.235 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.597343+0000 mon.a (mon.0) 543 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-07-20T15:03:01.236 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.597507+0000 mon.a (mon.0) 544 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-07-20T15:03:01.236 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.597665+0000 mon.a (mon.0) 545 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-07-20T15:03:01.236 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.597861+0000 mon.a (mon.0) 546 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-07-20T15:03:01.420 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:01 smithi178 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.5.service: Succeeded. 2023-07-20T15:03:01.421 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:01 smithi178 systemd[1]: Stopped Ceph osd.5 for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:03:01.421 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:01 smithi178 systemd[1]: Starting Ceph osd.5 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:03:01.421 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:01 smithi178 podman[110859]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.5" found: no such container 2023-07-20T15:03:01.421 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:01 smithi178 systemd[1]: Started Ceph osd.5 for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:03:02.145 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:01 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.833082+0000 mon.a (mon.0) 547 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:03:02.145 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:01 smithi178 bash[104918]: cluster 2023-07-20T15:03:00.837217+0000 mon.a (mon.0) 548 : cluster [DBG] osdmap e46: 7 total, 5 up, 6 in 2023-07-20T15:03:02.145 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:01 smithi178 bash[104918]: audit 2023-07-20T15:03:00.837885+0000 mon.a (mon.0) 549 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:02.145 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:01 smithi178 bash[110877]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-20T15:03:02.146 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:01 smithi178 bash[110877]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2023-07-20T15:03:02.146 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:01 smithi178 bash[110877]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2023-07-20T15:03:02.146 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:01 smithi178 bash[110877]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2023-07-20T15:03:02.146 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:01 smithi178 bash[110877]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-07-20T15:03:02.146 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:01 smithi178 bash[110877]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-20T15:03:02.146 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:01 smithi178 bash[110877]: --> ceph-volume lvm activate successful for osd ID: 5 2023-07-20T15:03:02.147 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:01 smithi178 bash[104918]: audit 2023-07-20T15:03:01.259943+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}}, \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:02.147 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:01 smithi178 bash[104918]: audit 2023-07-20T15:03:01.260379+0000 mon.a (mon.0) 551 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:02.147 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:01 smithi178 bash[104918]: audit 2023-07-20T15:03:01.263458+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}}, \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:02.147 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:01 smithi178 bash[104918]: audit 2023-07-20T15:03:01.264841+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-20T15:03:02.147 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:01 smithi178 bash[104918]: audit 2023-07-20T15:03:01.266073+0000 mon.a (mon.0) 554 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:02.147 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:01 smithi178 bash[104918]: audit 2023-07-20T15:03:01.267220+0000 mon.a (mon.0) 555 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2023-07-20T15:03:02.148 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:01 smithi178 bash[104918]: cluster 2023-07-20T15:03:01.839094+0000 mon.a (mon.0) 556 : cluster [DBG] osdmap e47: 7 total, 5 up, 6 in 2023-07-20T15:03:02.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.833082+0000 mon.a (mon.0) 547 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:03:02.213 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[104935]: cluster 2023-07-20T15:03:00.837217+0000 mon.a (mon.0) 548 : cluster [DBG] osdmap e46: 7 total, 5 up, 6 in 2023-07-20T15:03:02.214 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[104935]: audit 2023-07-20T15:03:00.837885+0000 mon.a (mon.0) 549 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:02.214 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.833082+0000 mon.a (mon.0) 547 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:03:02.214 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[108361]: cluster 2023-07-20T15:03:00.837217+0000 mon.a (mon.0) 548 : cluster [DBG] osdmap e46: 7 total, 5 up, 6 in 2023-07-20T15:03:02.215 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[108361]: audit 2023-07-20T15:03:00.837885+0000 mon.a (mon.0) 549 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:02.215 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[104935]: audit 2023-07-20T15:03:01.259943+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}}, \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:02.215 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[104935]: audit 2023-07-20T15:03:01.260379+0000 mon.a (mon.0) 551 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:02.215 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[108361]: audit 2023-07-20T15:03:01.259943+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}}, \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:02.216 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[108361]: audit 2023-07-20T15:03:01.260379+0000 mon.a (mon.0) 551 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:02.220 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[104935]: audit 2023-07-20T15:03:01.263458+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}}, \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:02.220 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[104935]: audit 2023-07-20T15:03:01.264841+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-20T15:03:02.220 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[104935]: audit 2023-07-20T15:03:01.266073+0000 mon.a (mon.0) 554 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:02.220 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[104935]: audit 2023-07-20T15:03:01.267220+0000 mon.a (mon.0) 555 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2023-07-20T15:03:02.220 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[104935]: cluster 2023-07-20T15:03:01.839094+0000 mon.a (mon.0) 556 : cluster [DBG] osdmap e47: 7 total, 5 up, 6 in 2023-07-20T15:03:02.221 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[108361]: audit 2023-07-20T15:03:01.263458+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}}, \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:02.221 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[108361]: audit 2023-07-20T15:03:01.264841+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-20T15:03:02.221 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[108361]: audit 2023-07-20T15:03:01.266073+0000 mon.a (mon.0) 554 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:02.221 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[108361]: audit 2023-07-20T15:03:01.267220+0000 mon.a (mon.0) 555 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2023-07-20T15:03:02.221 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:01 smithi029 bash[108361]: cluster 2023-07-20T15:03:01.839094+0000 mon.a (mon.0) 556 : cluster [DBG] osdmap e47: 7 total, 5 up, 6 in 2023-07-20T15:03:02.988 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 5,6 on host 'smithi178' 2023-07-20T15:03:03.150 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:02 smithi178 bash[104918]: cephadm 2023-07-20T15:03:01.266818+0000 mgr.y (mgr.14142) 113 : cephadm [INF] Deploying daemon osd.6 on smithi178 2023-07-20T15:03:03.150 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:02 smithi178 bash[104918]: cluster 2023-07-20T15:03:01.806006+0000 mgr.y (mgr.14142) 114 : cluster [DBG] pgmap v117: 1 pgs: 1 stale+active+clean; 0 B data, 2.4 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:03:03.150 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:02 smithi178 bash[104918]: audit 2023-07-20T15:03:01.839295+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:03.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:02 smithi029 bash[104935]: cephadm 2023-07-20T15:03:01.266818+0000 mgr.y (mgr.14142) 113 : cephadm [INF] Deploying daemon osd.6 on smithi178 2023-07-20T15:03:03.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:02 smithi029 bash[104935]: cluster 2023-07-20T15:03:01.806006+0000 mgr.y (mgr.14142) 114 : cluster [DBG] pgmap v117: 1 pgs: 1 stale+active+clean; 0 B data, 2.4 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:03:03.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:02 smithi029 bash[104935]: audit 2023-07-20T15:03:01.839295+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:03.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:02 smithi029 bash[108361]: cephadm 2023-07-20T15:03:01.266818+0000 mgr.y (mgr.14142) 113 : cephadm [INF] Deploying daemon osd.6 on smithi178 2023-07-20T15:03:03.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:02 smithi029 bash[108361]: cluster 2023-07-20T15:03:01.806006+0000 mgr.y (mgr.14142) 114 : cluster [DBG] pgmap v117: 1 pgs: 1 stale+active+clean; 0 B data, 2.4 MiB used, 530 GiB / 536 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:03:03.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:02 smithi029 bash[108361]: audit 2023-07-20T15:03:01.839295+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:03.419 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:03 smithi178 bash[111080]: debug 2023-07-20T15:03:03.224+0000 7f1405d28ec0 -1 Falling back to public interface 2023-07-20T15:03:03.626 DEBUG:teuthology.orchestra.run.smithi178:osd.6> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.6.service 2023-07-20T15:03:03.649 INFO:tasks.cephadm:Deploying osd.7 on smithi178 with /dev/vg_nvme/lv_1... 2023-07-20T15:03:03.649 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-07-20T15:03:03.678 INFO:journalctl@ceph.osd.6.smithi178.stdout:-- Logs begin at Thu 2023-07-20 14:49:59 UTC. -- 2023-07-20T15:03:04.121 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:03 smithi178 bash[111080]: debug 2023-07-20T15:03:03.787+0000 7f1405d28ec0 -1 osd.5 45 log_to_monitors {default=true} 2023-07-20T15:03:04.121 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:03 smithi178 bash[111080]: debug 2023-07-20T15:03:03.795+0000 7f13f9cf9700 -1 osd.5 45 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2023-07-20T15:03:04.122 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:03 smithi178 bash[104918]: audit 2023-07-20T15:03:02.936729+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:04.122 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:03 smithi178 bash[104918]: audit 2023-07-20T15:03:02.939484+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:04.122 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:03 smithi178 bash[104918]: audit 2023-07-20T15:03:02.948232+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947293\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947387\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947429\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947466\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:02.947560\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:04.122 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:03 smithi178 bash[104918]: audit 2023-07-20T15:03:02.951276+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947293\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947387\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947429\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947466\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:02.947560\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:04.123 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:03 smithi178 bash[104918]: audit 2023-07-20T15:03:02.952823+0000 mon.a (mon.0) 562 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:03:04.126 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:03 smithi178 bash[104918]: audit 2023-07-20T15:03:03.791861+0000 mon.b (mon.2) 17 : audit [INF] from='osd.5 [v2:172.21.15.178:6808/3613532761,v1:172.21.15.178:6809/3613532761]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-20T15:03:04.126 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:03 smithi178 bash[104918]: audit 2023-07-20T15:03:03.792303+0000 mon.a (mon.0) 563 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-20T15:03:04.127 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:03 smithi178 bash[104918]: audit 2023-07-20T15:03:03.792864+0000 mon.b (mon.2) 18 : audit [INF] from='osd.5 [v2:172.21.15.178:6808/3613532761,v1:172.21.15.178:6809/3613532761]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:04.128 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:03 smithi178 bash[104918]: audit 2023-07-20T15:03:03.793180+0000 mon.a (mon.0) 564 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:04.128 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:03 smithi178 bash[104918]: cluster 2023-07-20T15:03:03.806525+0000 mgr.y (mgr.14142) 115 : cluster [DBG] pgmap v119: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.5 MiB used, 530 GiB / 536 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:04.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[104935]: audit 2023-07-20T15:03:02.936729+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:04.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[108361]: audit 2023-07-20T15:03:02.936729+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:04.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[104935]: audit 2023-07-20T15:03:02.939484+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:04.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[108361]: audit 2023-07-20T15:03:02.939484+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969891\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.969988\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:49.970030\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_device_update\": \"2023-07-20T15:02:53.168650\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:04.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[108361]: audit 2023-07-20T15:03:02.948232+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947293\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947387\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947429\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947466\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:02.947560\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:04.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[104935]: audit 2023-07-20T15:03:02.948232+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947293\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947387\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947429\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947466\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:02.947560\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:04.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[104935]: audit 2023-07-20T15:03:02.951276+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947293\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947387\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947429\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947466\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:02.947560\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:04.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[104935]: audit 2023-07-20T15:03:02.952823+0000 mon.a (mon.0) 562 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:03:04.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[104935]: audit 2023-07-20T15:03:03.791861+0000 mon.b (mon.2) 17 : audit [INF] from='osd.5 [v2:172.21.15.178:6808/3613532761,v1:172.21.15.178:6809/3613532761]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-20T15:03:04.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[104935]: audit 2023-07-20T15:03:03.792303+0000 mon.a (mon.0) 563 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-20T15:03:04.216 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[104935]: audit 2023-07-20T15:03:03.792864+0000 mon.b (mon.2) 18 : audit [INF] from='osd.5 [v2:172.21.15.178:6808/3613532761,v1:172.21.15.178:6809/3613532761]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:04.217 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[104935]: audit 2023-07-20T15:03:03.793180+0000 mon.a (mon.0) 564 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:04.217 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[104935]: cluster 2023-07-20T15:03:03.806525+0000 mgr.y (mgr.14142) 115 : cluster [DBG] pgmap v119: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.5 MiB used, 530 GiB / 536 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:04.217 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[108361]: audit 2023-07-20T15:03:02.951276+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947293\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947387\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947429\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947466\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:02.947560\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:04.217 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[108361]: audit 2023-07-20T15:03:02.952823+0000 mon.a (mon.0) 562 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:03:04.218 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[108361]: audit 2023-07-20T15:03:03.791861+0000 mon.b (mon.2) 17 : audit [INF] from='osd.5 [v2:172.21.15.178:6808/3613532761,v1:172.21.15.178:6809/3613532761]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-20T15:03:04.218 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[108361]: audit 2023-07-20T15:03:03.792303+0000 mon.a (mon.0) 563 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-20T15:03:04.218 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[108361]: audit 2023-07-20T15:03:03.792864+0000 mon.b (mon.2) 18 : audit [INF] from='osd.5 [v2:172.21.15.178:6808/3613532761,v1:172.21.15.178:6809/3613532761]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:04.218 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[108361]: audit 2023-07-20T15:03:03.793180+0000 mon.a (mon.0) 564 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:04.218 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:03 smithi029 bash[108361]: cluster 2023-07-20T15:03:03.806525+0000 mgr.y (mgr.14142) 115 : cluster [DBG] pgmap v119: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.5 MiB used, 530 GiB / 536 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:05.129 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:04 smithi178 bash[104918]: cluster 2023-07-20T15:03:03.949910+0000 mon.a (mon.0) 565 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:03:05.129 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:04 smithi178 bash[104918]: cluster 2023-07-20T15:03:03.949959+0000 mon.a (mon.0) 566 : cluster [INF] Cluster is now healthy 2023-07-20T15:03:05.130 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:04 smithi178 bash[104918]: cluster 2023-07-20T15:03:03.950300+0000 mon.a (mon.0) 567 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-07-20T15:03:05.130 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:04 smithi178 bash[104918]: cluster 2023-07-20T15:03:03.954154+0000 mon.a (mon.0) 568 : cluster [INF] osd.5 [v2:172.21.15.178:6808/3613532761,v1:172.21.15.178:6809/3613532761] boot 2023-07-20T15:03:05.130 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:04 smithi178 bash[104918]: cluster 2023-07-20T15:03:03.954223+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e48: 7 total, 6 up, 6 in 2023-07-20T15:03:05.130 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:04 smithi178 bash[104918]: audit 2023-07-20T15:03:03.954668+0000 mon.a (mon.0) 570 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:03:05.130 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:04 smithi178 bash[104918]: audit 2023-07-20T15:03:03.955197+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:05.208 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:04 smithi029 bash[104935]: cluster 2023-07-20T15:03:03.949910+0000 mon.a (mon.0) 565 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:03:05.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:04 smithi029 bash[104935]: cluster 2023-07-20T15:03:03.949959+0000 mon.a (mon.0) 566 : cluster [INF] Cluster is now healthy 2023-07-20T15:03:05.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:04 smithi029 bash[104935]: cluster 2023-07-20T15:03:03.950300+0000 mon.a (mon.0) 567 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-07-20T15:03:05.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:04 smithi029 bash[104935]: cluster 2023-07-20T15:03:03.954154+0000 mon.a (mon.0) 568 : cluster [INF] osd.5 [v2:172.21.15.178:6808/3613532761,v1:172.21.15.178:6809/3613532761] boot 2023-07-20T15:03:05.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:04 smithi029 bash[104935]: cluster 2023-07-20T15:03:03.954223+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e48: 7 total, 6 up, 6 in 2023-07-20T15:03:05.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:04 smithi029 bash[104935]: audit 2023-07-20T15:03:03.954668+0000 mon.a (mon.0) 570 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:03:05.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:04 smithi029 bash[104935]: audit 2023-07-20T15:03:03.955197+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:05.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:04 smithi029 bash[108361]: cluster 2023-07-20T15:03:03.949910+0000 mon.a (mon.0) 565 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:03:05.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:04 smithi029 bash[108361]: cluster 2023-07-20T15:03:03.949959+0000 mon.a (mon.0) 566 : cluster [INF] Cluster is now healthy 2023-07-20T15:03:05.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:04 smithi029 bash[108361]: cluster 2023-07-20T15:03:03.950300+0000 mon.a (mon.0) 567 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-07-20T15:03:05.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:04 smithi029 bash[108361]: cluster 2023-07-20T15:03:03.954154+0000 mon.a (mon.0) 568 : cluster [INF] osd.5 [v2:172.21.15.178:6808/3613532761,v1:172.21.15.178:6809/3613532761] boot 2023-07-20T15:03:05.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:04 smithi029 bash[108361]: cluster 2023-07-20T15:03:03.954223+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e48: 7 total, 6 up, 6 in 2023-07-20T15:03:05.211 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:04 smithi029 bash[108361]: audit 2023-07-20T15:03:03.954668+0000 mon.a (mon.0) 570 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:03:05.211 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:04 smithi029 bash[108361]: audit 2023-07-20T15:03:03.955197+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:05.425 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:05 smithi178 bash[111602]: debug 2023-07-20T15:03:05.230+0000 7f4905205ec0 -1 Falling back to public interface 2023-07-20T15:03:05.749 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-07-20T15:03:05.749 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-07-20T15:03:05.749 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2023-07-20T15:03:05.749 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2023-07-20T15:03:05.749 INFO:teuthology.orchestra.run.smithi178.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0137155 s, 765 MB/s 2023-07-20T15:03:05.750 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2023-07-20T15:03:06.006 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:05 smithi178 bash[111602]: debug 2023-07-20T15:03:05.795+0000 7f4905205ec0 -1 osd.6 0 log_to_monitors {default=true} 2023-07-20T15:03:06.364 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:05 smithi178 bash[104918]: cluster 2023-07-20T15:03:04.959511+0000 mon.a (mon.0) 572 : cluster [DBG] osdmap e49: 7 total, 6 up, 6 in 2023-07-20T15:03:06.364 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:05 smithi178 bash[104918]: audit 2023-07-20T15:03:04.959686+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:06.364 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:05 smithi178 bash[104918]: audit 2023-07-20T15:03:05.800002+0000 mon.b (mon.2) 19 : audit [INF] from='osd.6 [v2:172.21.15.178:6816/2993660341,v1:172.21.15.178:6817/2993660341]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-20T15:03:06.365 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:05 smithi178 bash[104918]: audit 2023-07-20T15:03:05.800399+0000 mon.a (mon.0) 574 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-20T15:03:06.365 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:05 smithi178 bash[104918]: cluster 2023-07-20T15:03:05.806892+0000 mgr.y (mgr.14142) 116 : cluster [DBG] pgmap v122: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.5 MiB used, 530 GiB / 536 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:06.385 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi178:vg_nvme/lv_1 2023-07-20T15:03:06.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:05 smithi029 bash[104935]: cluster 2023-07-20T15:03:04.959511+0000 mon.a (mon.0) 572 : cluster [DBG] osdmap e49: 7 total, 6 up, 6 in 2023-07-20T15:03:06.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:05 smithi029 bash[104935]: audit 2023-07-20T15:03:04.959686+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:06.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:05 smithi029 bash[104935]: audit 2023-07-20T15:03:05.800002+0000 mon.b (mon.2) 19 : audit [INF] from='osd.6 [v2:172.21.15.178:6816/2993660341,v1:172.21.15.178:6817/2993660341]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-20T15:03:06.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:05 smithi029 bash[104935]: audit 2023-07-20T15:03:05.800399+0000 mon.a (mon.0) 574 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-20T15:03:06.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:05 smithi029 bash[104935]: cluster 2023-07-20T15:03:05.806892+0000 mgr.y (mgr.14142) 116 : cluster [DBG] pgmap v122: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.5 MiB used, 530 GiB / 536 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:06.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:05 smithi029 bash[108361]: cluster 2023-07-20T15:03:04.959511+0000 mon.a (mon.0) 572 : cluster [DBG] osdmap e49: 7 total, 6 up, 6 in 2023-07-20T15:03:06.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:05 smithi029 bash[108361]: audit 2023-07-20T15:03:04.959686+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:06.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:05 smithi029 bash[108361]: audit 2023-07-20T15:03:05.800002+0000 mon.b (mon.2) 19 : audit [INF] from='osd.6 [v2:172.21.15.178:6816/2993660341,v1:172.21.15.178:6817/2993660341]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-20T15:03:06.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:05 smithi029 bash[108361]: audit 2023-07-20T15:03:05.800399+0000 mon.a (mon.0) 574 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-20T15:03:06.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:05 smithi029 bash[108361]: cluster 2023-07-20T15:03:05.806892+0000 mgr.y (mgr.14142) 116 : cluster [DBG] pgmap v122: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.5 MiB used, 530 GiB / 536 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:07.287 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:06 smithi178 bash[104918]: audit 2023-07-20T15:03:05.964920+0000 mon.a (mon.0) 575 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-07-20T15:03:07.287 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:06 smithi178 bash[104918]: cluster 2023-07-20T15:03:05.964985+0000 mon.a (mon.0) 576 : cluster [DBG] osdmap e50: 7 total, 6 up, 6 in 2023-07-20T15:03:07.287 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:06 smithi178 bash[104918]: audit 2023-07-20T15:03:05.965375+0000 mon.a (mon.0) 577 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:07.287 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:06 smithi178 bash[104918]: audit 2023-07-20T15:03:05.965456+0000 mon.b (mon.2) 20 : audit [INF] from='osd.6 [v2:172.21.15.178:6816/2993660341,v1:172.21.15.178:6817/2993660341]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:07.288 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:06 smithi178 bash[104918]: audit 2023-07-20T15:03:05.965892+0000 mon.a (mon.0) 578 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:07.288 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:06 smithi178 bash[104918]: audit 2023-07-20T15:03:06.071351+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:07.290 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:06 smithi178 bash[111602]: debug 2023-07-20T15:03:06.968+0000 7f48e9fb2700 -1 osd.6 0 waiting for initial osdmap 2023-07-20T15:03:07.290 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:06 smithi178 bash[111602]: debug 2023-07-20T15:03:06.981+0000 7f48f51ce700 -1 osd.6 51 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2023-07-20T15:03:07.290 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:06 smithi178 bash[104918]: audit 2023-07-20T15:03:06.260663+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947293\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947387\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947429\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947466\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:02.947560\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:07.290 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:06 smithi178 bash[104918]: audit 2023-07-20T15:03:06.263731+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947293\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947387\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947429\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947466\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:02.947560\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:07.291 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:06 smithi178 bash[104918]: audit 2023-07-20T15:03:06.265351+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:07.294 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:06 smithi178 bash[104918]: cluster 2023-07-20T15:03:06.765827+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:03:07.294 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:06 smithi178 bash[104918]: cluster 2023-07-20T15:03:06.765867+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:03:07.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[104935]: audit 2023-07-20T15:03:05.964920+0000 mon.a (mon.0) 575 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-07-20T15:03:07.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[104935]: cluster 2023-07-20T15:03:05.964985+0000 mon.a (mon.0) 576 : cluster [DBG] osdmap e50: 7 total, 6 up, 6 in 2023-07-20T15:03:07.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[104935]: audit 2023-07-20T15:03:05.965375+0000 mon.a (mon.0) 577 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:07.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[104935]: audit 2023-07-20T15:03:05.965456+0000 mon.b (mon.2) 20 : audit [INF] from='osd.6 [v2:172.21.15.178:6816/2993660341,v1:172.21.15.178:6817/2993660341]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:07.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[104935]: audit 2023-07-20T15:03:05.965892+0000 mon.a (mon.0) 578 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:07.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[104935]: audit 2023-07-20T15:03:06.071351+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:07.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[108361]: audit 2023-07-20T15:03:05.964920+0000 mon.a (mon.0) 575 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-07-20T15:03:07.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[108361]: cluster 2023-07-20T15:03:05.964985+0000 mon.a (mon.0) 576 : cluster [DBG] osdmap e50: 7 total, 6 up, 6 in 2023-07-20T15:03:07.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[108361]: audit 2023-07-20T15:03:05.965375+0000 mon.a (mon.0) 577 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:07.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[108361]: audit 2023-07-20T15:03:05.965456+0000 mon.b (mon.2) 20 : audit [INF] from='osd.6 [v2:172.21.15.178:6816/2993660341,v1:172.21.15.178:6817/2993660341]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:07.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[108361]: audit 2023-07-20T15:03:05.965892+0000 mon.a (mon.0) 578 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:07.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[108361]: audit 2023-07-20T15:03:06.071351+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:07.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[104935]: audit 2023-07-20T15:03:06.260663+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947293\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947387\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947429\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947466\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:02.947560\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:07.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[108361]: audit 2023-07-20T15:03:06.260663+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947293\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947387\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947429\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947466\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:02.947560\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:07.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[104935]: audit 2023-07-20T15:03:06.263731+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947293\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947387\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947429\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947466\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:02.947560\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:07.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[104935]: audit 2023-07-20T15:03:06.265351+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:07.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[104935]: cluster 2023-07-20T15:03:06.765827+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:03:07.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[104935]: cluster 2023-07-20T15:03:06.765867+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:03:07.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[108361]: audit 2023-07-20T15:03:06.263731+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947293\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947387\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947429\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:02.947466\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:02.947560\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:07.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[108361]: audit 2023-07-20T15:03:06.265351+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:07.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[108361]: cluster 2023-07-20T15:03:06.765827+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:03:07.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:06 smithi029 bash[108361]: cluster 2023-07-20T15:03:06.765867+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:03:08.275 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:07 smithi178 bash[104918]: audit 2023-07-20T15:03:06.966274+0000 mon.a (mon.0) 583 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-07-20T15:03:08.275 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:07 smithi178 bash[104918]: cluster 2023-07-20T15:03:06.966351+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e51: 7 total, 6 up, 6 in 2023-07-20T15:03:08.275 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:07 smithi178 bash[104918]: audit 2023-07-20T15:03:06.966981+0000 mon.a (mon.0) 585 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:08.276 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:07 smithi178 bash[104918]: audit 2023-07-20T15:03:07.513230+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512179\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512289\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512330\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512366\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"6df5daba9e1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512401\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:04.038082\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:07.512497\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:08.276 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:07 smithi178 bash[104918]: audit 2023-07-20T15:03:07.516644+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512179\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512289\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512330\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512366\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"6df5daba9e1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512401\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:04.038082\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:07.512497\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:08.276 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:07 smithi178 bash[104918]: cluster 2023-07-20T15:03:07.807265+0000 mgr.y (mgr.14142) 117 : cluster [DBG] pgmap v125: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.5 MiB used, 530 GiB / 536 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:08.276 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:07 smithi178 bash[104918]: audit 2023-07-20T15:03:07.954378+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:03:08.276 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:07 smithi178 bash[104918]: audit 2023-07-20T15:03:07.955136+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:08.277 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:07 smithi178 bash[104918]: audit 2023-07-20T15:03:07.956307+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:03:08.277 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:07 smithi178 bash[104918]: cluster 2023-07-20T15:03:07.967604+0000 mon.a (mon.0) 591 : cluster [INF] osd.6 [v2:172.21.15.178:6816/2993660341,v1:172.21.15.178:6817/2993660341] boot 2023-07-20T15:03:08.277 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:07 smithi178 bash[104918]: cluster 2023-07-20T15:03:07.967643+0000 mon.a (mon.0) 592 : cluster [DBG] osdmap e52: 7 total, 7 up, 7 in 2023-07-20T15:03:08.277 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:07 smithi178 bash[104918]: audit 2023-07-20T15:03:07.967794+0000 mon.a (mon.0) 593 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:08.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[104935]: audit 2023-07-20T15:03:06.966274+0000 mon.a (mon.0) 583 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-07-20T15:03:08.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[104935]: cluster 2023-07-20T15:03:06.966351+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e51: 7 total, 6 up, 6 in 2023-07-20T15:03:08.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[104935]: audit 2023-07-20T15:03:06.966981+0000 mon.a (mon.0) 585 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:08.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[108361]: audit 2023-07-20T15:03:06.966274+0000 mon.a (mon.0) 583 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-07-20T15:03:08.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[108361]: cluster 2023-07-20T15:03:06.966351+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e51: 7 total, 6 up, 6 in 2023-07-20T15:03:08.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[108361]: audit 2023-07-20T15:03:06.966981+0000 mon.a (mon.0) 585 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:08.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[104935]: audit 2023-07-20T15:03:07.513230+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512179\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512289\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512330\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512366\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"6df5daba9e1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512401\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:04.038082\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:07.512497\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:08.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[108361]: audit 2023-07-20T15:03:07.513230+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512179\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512289\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512330\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512366\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"6df5daba9e1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512401\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:04.038082\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:07.512497\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:08.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[104935]: audit 2023-07-20T15:03:07.516644+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512179\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512289\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512330\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512366\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"6df5daba9e1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512401\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:04.038082\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:07.512497\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:08.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[108361]: audit 2023-07-20T15:03:07.516644+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512179\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512289\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512330\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512366\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"6df5daba9e1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512401\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:04.038082\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:01.264611\"}}, \"last_daemon_update\": \"2023-07-20T15:03:07.512497\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:08.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[104935]: cluster 2023-07-20T15:03:07.807265+0000 mgr.y (mgr.14142) 117 : cluster [DBG] pgmap v125: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.5 MiB used, 530 GiB / 536 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:08.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[104935]: audit 2023-07-20T15:03:07.954378+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:03:08.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[104935]: audit 2023-07-20T15:03:07.955136+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:08.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[104935]: audit 2023-07-20T15:03:07.956307+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:03:08.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[104935]: cluster 2023-07-20T15:03:07.967604+0000 mon.a (mon.0) 591 : cluster [INF] osd.6 [v2:172.21.15.178:6816/2993660341,v1:172.21.15.178:6817/2993660341] boot 2023-07-20T15:03:08.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[104935]: cluster 2023-07-20T15:03:07.967643+0000 mon.a (mon.0) 592 : cluster [DBG] osdmap e52: 7 total, 7 up, 7 in 2023-07-20T15:03:08.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[104935]: audit 2023-07-20T15:03:07.967794+0000 mon.a (mon.0) 593 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:08.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[108361]: cluster 2023-07-20T15:03:07.807265+0000 mgr.y (mgr.14142) 117 : cluster [DBG] pgmap v125: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.5 MiB used, 530 GiB / 536 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:08.464 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[108361]: audit 2023-07-20T15:03:07.954378+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-20T15:03:08.464 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[108361]: audit 2023-07-20T15:03:07.955136+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:08.464 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[108361]: audit 2023-07-20T15:03:07.956307+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:03:08.465 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[108361]: cluster 2023-07-20T15:03:07.967604+0000 mon.a (mon.0) 591 : cluster [INF] osd.6 [v2:172.21.15.178:6816/2993660341,v1:172.21.15.178:6817/2993660341] boot 2023-07-20T15:03:08.465 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[108361]: cluster 2023-07-20T15:03:07.967643+0000 mon.a (mon.0) 592 : cluster [DBG] osdmap e52: 7 total, 7 up, 7 in 2023-07-20T15:03:08.472 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:07 smithi029 bash[108361]: audit 2023-07-20T15:03:07.967794+0000 mon.a (mon.0) 593 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:09.019 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:08 smithi178 bash[111080]: debug 2023-07-20T15:03:08.974+0000 7f13e3ccd700 -1 osd.5 53 build_incremental_map_msg missing incremental map 53 2023-07-20T15:03:09.419 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:08 smithi178 bash[111080]: debug 2023-07-20T15:03:08.990+0000 7f13ffd75700 -1 osd.5 53 build_incremental_map_msg missing incremental map 53 2023-07-20T15:03:09.420 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:03:08 smithi178 bash[111080]: debug 2023-07-20T15:03:08.991+0000 7f1400576700 -1 osd.5 53 build_incremental_map_msg missing incremental map 53 2023-07-20T15:03:09.920 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:09 smithi178 bash[104918]: audit 2023-07-20T15:03:07.953178+0000 mgr.y (mgr.14142) 118 : audit [DBG] from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:03:09.921 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:09 smithi178 bash[104918]: cephadm 2023-07-20T15:03:07.954062+0000 mgr.y (mgr.14142) 119 : cephadm [INF] Applying osd on host smithi178... 2023-07-20T15:03:09.921 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:09 smithi178 bash[104918]: cluster 2023-07-20T15:03:08.974343+0000 mon.a (mon.0) 594 : cluster [DBG] osdmap e53: 7 total, 7 up, 7 in 2023-07-20T15:03:09.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:09 smithi029 bash[104935]: audit 2023-07-20T15:03:07.953178+0000 mgr.y (mgr.14142) 118 : audit [DBG] from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:03:09.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:09 smithi029 bash[104935]: cephadm 2023-07-20T15:03:07.954062+0000 mgr.y (mgr.14142) 119 : cephadm [INF] Applying osd on host smithi178... 2023-07-20T15:03:09.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:09 smithi029 bash[104935]: cluster 2023-07-20T15:03:08.974343+0000 mon.a (mon.0) 594 : cluster [DBG] osdmap e53: 7 total, 7 up, 7 in 2023-07-20T15:03:09.949 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:09 smithi029 bash[108361]: audit 2023-07-20T15:03:07.953178+0000 mgr.y (mgr.14142) 118 : audit [DBG] from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:03:09.950 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:09 smithi029 bash[108361]: cephadm 2023-07-20T15:03:07.954062+0000 mgr.y (mgr.14142) 119 : cephadm [INF] Applying osd on host smithi178... 2023-07-20T15:03:09.950 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:09 smithi029 bash[108361]: cluster 2023-07-20T15:03:08.974343+0000 mon.a (mon.0) 594 : cluster [DBG] osdmap e53: 7 total, 7 up, 7 in 2023-07-20T15:03:10.919 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:10 smithi178 bash[104918]: audit 2023-07-20T15:03:09.514890+0000 mon.b (mon.2) 21 : audit [INF] from='client.? 172.21.15.178:0/2066226115' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b"}]: dispatch 2023-07-20T15:03:10.920 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:10 smithi178 bash[104918]: audit 2023-07-20T15:03:09.515414+0000 mon.a (mon.0) 595 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b"}]: dispatch 2023-07-20T15:03:10.920 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:10 smithi178 bash[104918]: audit 2023-07-20T15:03:09.519842+0000 mon.a (mon.0) 596 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b"}]': finished 2023-07-20T15:03:10.920 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:10 smithi178 bash[104918]: cluster 2023-07-20T15:03:09.519888+0000 mon.a (mon.0) 597 : cluster [DBG] osdmap e54: 8 total, 7 up, 7 in 2023-07-20T15:03:10.920 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:10 smithi178 bash[104918]: audit 2023-07-20T15:03:09.520414+0000 mon.a (mon.0) 598 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:10.920 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:10 smithi178 bash[104918]: cluster 2023-07-20T15:03:09.807620+0000 mgr.y (mgr.14142) 120 : cluster [DBG] pgmap v129: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.3 MiB used, 619 GiB / 626 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:10.920 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:10 smithi178 bash[104918]: audit 2023-07-20T15:03:10.232389+0000 mon.b (mon.2) 22 : audit [DBG] from='client.? 172.21.15.178:0/1189672955' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:03:10.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:10 smithi029 bash[104935]: audit 2023-07-20T15:03:09.514890+0000 mon.b (mon.2) 21 : audit [INF] from='client.? 172.21.15.178:0/2066226115' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b"}]: dispatch 2023-07-20T15:03:10.966 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:10 smithi029 bash[104935]: audit 2023-07-20T15:03:09.515414+0000 mon.a (mon.0) 595 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b"}]: dispatch 2023-07-20T15:03:10.966 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:10 smithi029 bash[104935]: audit 2023-07-20T15:03:09.519842+0000 mon.a (mon.0) 596 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b"}]': finished 2023-07-20T15:03:10.966 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:10 smithi029 bash[104935]: cluster 2023-07-20T15:03:09.519888+0000 mon.a (mon.0) 597 : cluster [DBG] osdmap e54: 8 total, 7 up, 7 in 2023-07-20T15:03:10.966 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:10 smithi029 bash[104935]: audit 2023-07-20T15:03:09.520414+0000 mon.a (mon.0) 598 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:10.966 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:10 smithi029 bash[104935]: cluster 2023-07-20T15:03:09.807620+0000 mgr.y (mgr.14142) 120 : cluster [DBG] pgmap v129: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.3 MiB used, 619 GiB / 626 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:10.967 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:10 smithi029 bash[104935]: audit 2023-07-20T15:03:10.232389+0000 mon.b (mon.2) 22 : audit [DBG] from='client.? 172.21.15.178:0/1189672955' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:03:10.967 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:10 smithi029 bash[108361]: audit 2023-07-20T15:03:09.514890+0000 mon.b (mon.2) 21 : audit [INF] from='client.? 172.21.15.178:0/2066226115' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b"}]: dispatch 2023-07-20T15:03:10.967 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:10 smithi029 bash[108361]: audit 2023-07-20T15:03:09.515414+0000 mon.a (mon.0) 595 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b"}]: dispatch 2023-07-20T15:03:10.967 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:10 smithi029 bash[108361]: audit 2023-07-20T15:03:09.519842+0000 mon.a (mon.0) 596 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b"}]': finished 2023-07-20T15:03:10.967 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:10 smithi029 bash[108361]: cluster 2023-07-20T15:03:09.519888+0000 mon.a (mon.0) 597 : cluster [DBG] osdmap e54: 8 total, 7 up, 7 in 2023-07-20T15:03:10.967 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:10 smithi029 bash[108361]: audit 2023-07-20T15:03:09.520414+0000 mon.a (mon.0) 598 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:10.968 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:10 smithi029 bash[108361]: cluster 2023-07-20T15:03:09.807620+0000 mgr.y (mgr.14142) 120 : cluster [DBG] pgmap v129: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.3 MiB used, 619 GiB / 626 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:10.968 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:10 smithi029 bash[108361]: audit 2023-07-20T15:03:10.232389+0000 mon.b (mon.2) 22 : audit [DBG] from='client.? 172.21.15.178:0/1189672955' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-20T15:03:12.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:11 smithi029 bash[104935]: cluster 2023-07-20T15:03:11.808054+0000 mgr.y (mgr.14142) 121 : cluster [DBG] pgmap v130: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.3 MiB used, 619 GiB / 626 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:12.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:11 smithi029 bash[108361]: cluster 2023-07-20T15:03:11.808054+0000 mgr.y (mgr.14142) 121 : cluster [DBG] pgmap v130: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.3 MiB used, 619 GiB / 626 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:12.334 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:11 smithi178 bash[104918]: cluster 2023-07-20T15:03:11.808054+0000 mgr.y (mgr.14142) 121 : cluster [DBG] pgmap v130: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.3 MiB used, 619 GiB / 626 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:13.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:12 smithi178 bash[104918]: audit 2023-07-20T15:03:12.496724+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:03:13.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:12 smithi029 bash[104935]: audit 2023-07-20T15:03:12.496724+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:03:13.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:12 smithi029 bash[108361]: audit 2023-07-20T15:03:12.496724+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:03:14.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:13 smithi029 bash[104935]: cluster 2023-07-20T15:03:13.808469+0000 mgr.y (mgr.14142) 122 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 619 GiB / 626 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:03:14.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:13 smithi029 bash[108361]: cluster 2023-07-20T15:03:13.808469+0000 mgr.y (mgr.14142) 122 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 619 GiB / 626 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:03:14.279 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:13 smithi178 bash[104918]: cluster 2023-07-20T15:03:13.808469+0000 mgr.y (mgr.14142) 122 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 619 GiB / 626 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:03:15.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:14 smithi029 bash[104935]: cluster 2023-07-20T15:03:13.893772+0000 mon.a (mon.0) 600 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2023-07-20T15:03:15.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:14 smithi029 bash[104935]: cluster 2023-07-20T15:03:13.893836+0000 mon.a (mon.0) 601 : cluster [INF] Cluster is now healthy 2023-07-20T15:03:15.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:14 smithi029 bash[104935]: audit 2023-07-20T15:03:14.287946+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-20T15:03:15.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:14 smithi029 bash[104935]: audit 2023-07-20T15:03:14.288783+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:15.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:14 smithi029 bash[104935]: cephadm 2023-07-20T15:03:14.289380+0000 mgr.y (mgr.14142) 123 : cephadm [INF] Deploying daemon osd.6 on smithi178 2023-07-20T15:03:15.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:14 smithi029 bash[104935]: audit 2023-07-20T15:03:14.289655+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2023-07-20T15:03:15.199 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:14 smithi029 bash[108361]: cluster 2023-07-20T15:03:13.893772+0000 mon.a (mon.0) 600 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2023-07-20T15:03:15.199 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:14 smithi029 bash[108361]: cluster 2023-07-20T15:03:13.893836+0000 mon.a (mon.0) 601 : cluster [INF] Cluster is now healthy 2023-07-20T15:03:15.199 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:14 smithi029 bash[108361]: audit 2023-07-20T15:03:14.287946+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-20T15:03:15.199 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:14 smithi029 bash[108361]: audit 2023-07-20T15:03:14.288783+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:15.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:14 smithi029 bash[108361]: cephadm 2023-07-20T15:03:14.289380+0000 mgr.y (mgr.14142) 123 : cephadm [INF] Deploying daemon osd.6 on smithi178 2023-07-20T15:03:15.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:14 smithi029 bash[108361]: audit 2023-07-20T15:03:14.289655+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2023-07-20T15:03:15.256 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:14 smithi178 bash[104918]: cluster 2023-07-20T15:03:13.893772+0000 mon.a (mon.0) 600 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2023-07-20T15:03:15.256 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:14 smithi178 bash[104918]: cluster 2023-07-20T15:03:13.893836+0000 mon.a (mon.0) 601 : cluster [INF] Cluster is now healthy 2023-07-20T15:03:15.256 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:14 smithi178 bash[104918]: audit 2023-07-20T15:03:14.287946+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-20T15:03:15.257 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:14 smithi178 bash[104918]: audit 2023-07-20T15:03:14.288783+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:15.257 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:14 smithi178 bash[104918]: cephadm 2023-07-20T15:03:14.289380+0000 mgr.y (mgr.14142) 123 : cephadm [INF] Deploying daemon osd.6 on smithi178 2023-07-20T15:03:15.257 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:14 smithi178 bash[104918]: audit 2023-07-20T15:03:14.289655+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2023-07-20T15:03:15.542 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:15 smithi178 systemd[1]: Stopping Ceph osd.6 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:03:15.542 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[111602]: debug 2023-07-20T15:03:15.269+0000 7f48fca4d700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T15:03:15.542 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[111602]: debug 2023-07-20T15:03:15.269+0000 7f48fca4d700 -1 osd.6 54 *** Got signal Terminated *** 2023-07-20T15:03:15.542 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[111602]: debug 2023-07-20T15:03:15.269+0000 7f48fca4d700 -1 osd.6 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-20T15:03:15.919 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:15 smithi178 podman[112918]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.6 2023-07-20T15:03:16.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.315779+0000 mon.a (mon.0) 605 : cluster [DBG] osd.6 reported immediately failed by osd.3 2023-07-20T15:03:16.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.315847+0000 mon.a (mon.0) 606 : cluster [INF] osd.6 failed (root=default,host=smithi178) (connection refused reported by osd.3) 2023-07-20T15:03:16.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.316039+0000 mon.a (mon.0) 607 : cluster [DBG] osd.6 reported immediately failed by osd.3 2023-07-20T15:03:16.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.316146+0000 mon.a (mon.0) 608 : cluster [DBG] osd.6 reported immediately failed by osd.0 2023-07-20T15:03:16.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.316317+0000 mon.a (mon.0) 609 : cluster [DBG] osd.6 reported immediately failed by osd.1 2023-07-20T15:03:16.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.316371+0000 mon.a (mon.0) 610 : cluster [DBG] osd.6 reported immediately failed by osd.2 2023-07-20T15:03:16.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.316536+0000 mon.a (mon.0) 611 : cluster [DBG] osd.6 reported immediately failed by osd.0 2023-07-20T15:03:16.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.316626+0000 mon.a (mon.0) 612 : cluster [DBG] osd.6 reported immediately failed by osd.1 2023-07-20T15:03:16.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.316732+0000 mon.a (mon.0) 613 : cluster [DBG] osd.6 reported immediately failed by osd.2 2023-07-20T15:03:16.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.516487+0000 mon.a (mon.0) 614 : cluster [DBG] osd.6 reported immediately failed by osd.4 2023-07-20T15:03:16.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.516776+0000 mon.a (mon.0) 615 : cluster [DBG] osd.6 reported immediately failed by osd.5 2023-07-20T15:03:16.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.516877+0000 mon.a (mon.0) 616 : cluster [DBG] osd.6 reported immediately failed by osd.2 2023-07-20T15:03:16.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.517090+0000 mon.a (mon.0) 617 : cluster [DBG] osd.6 reported immediately failed by osd.3 2023-07-20T15:03:16.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.517329+0000 mon.a (mon.0) 618 : cluster [DBG] osd.6 reported immediately failed by osd.0 2023-07-20T15:03:16.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.517529+0000 mon.a (mon.0) 619 : cluster [DBG] osd.6 reported immediately failed by osd.4 2023-07-20T15:03:16.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.517694+0000 mon.a (mon.0) 620 : cluster [DBG] osd.6 reported immediately failed by osd.1 2023-07-20T15:03:16.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.517838+0000 mon.a (mon.0) 621 : cluster [DBG] osd.6 reported immediately failed by osd.2 2023-07-20T15:03:16.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.517984+0000 mon.a (mon.0) 622 : cluster [DBG] osd.6 reported immediately failed by osd.3 2023-07-20T15:03:16.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.518174+0000 mon.a (mon.0) 623 : cluster [DBG] osd.6 reported immediately failed by osd.0 2023-07-20T15:03:16.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.518384+0000 mon.a (mon.0) 624 : cluster [DBG] osd.6 reported immediately failed by osd.5 2023-07-20T15:03:16.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.518545+0000 mon.a (mon.0) 625 : cluster [DBG] osd.6 reported immediately failed by osd.1 2023-07-20T15:03:16.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.518701+0000 mon.a (mon.0) 626 : cluster [DBG] osd.6 reported immediately failed by osd.2 2023-07-20T15:03:16.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.809067+0000 mgr.y (mgr.14142) 124 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 619 GiB / 626 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:03:16.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.315779+0000 mon.a (mon.0) 605 : cluster [DBG] osd.6 reported immediately failed by osd.3 2023-07-20T15:03:16.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.315847+0000 mon.a (mon.0) 606 : cluster [INF] osd.6 failed (root=default,host=smithi178) (connection refused reported by osd.3) 2023-07-20T15:03:16.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.316039+0000 mon.a (mon.0) 607 : cluster [DBG] osd.6 reported immediately failed by osd.3 2023-07-20T15:03:16.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.316146+0000 mon.a (mon.0) 608 : cluster [DBG] osd.6 reported immediately failed by osd.0 2023-07-20T15:03:16.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.316317+0000 mon.a (mon.0) 609 : cluster [DBG] osd.6 reported immediately failed by osd.1 2023-07-20T15:03:16.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.316371+0000 mon.a (mon.0) 610 : cluster [DBG] osd.6 reported immediately failed by osd.2 2023-07-20T15:03:16.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.316536+0000 mon.a (mon.0) 611 : cluster [DBG] osd.6 reported immediately failed by osd.0 2023-07-20T15:03:16.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.316626+0000 mon.a (mon.0) 612 : cluster [DBG] osd.6 reported immediately failed by osd.1 2023-07-20T15:03:16.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.316732+0000 mon.a (mon.0) 613 : cluster [DBG] osd.6 reported immediately failed by osd.2 2023-07-20T15:03:16.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.516487+0000 mon.a (mon.0) 614 : cluster [DBG] osd.6 reported immediately failed by osd.4 2023-07-20T15:03:16.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.516776+0000 mon.a (mon.0) 615 : cluster [DBG] osd.6 reported immediately failed by osd.5 2023-07-20T15:03:16.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.516877+0000 mon.a (mon.0) 616 : cluster [DBG] osd.6 reported immediately failed by osd.2 2023-07-20T15:03:16.212 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.517090+0000 mon.a (mon.0) 617 : cluster [DBG] osd.6 reported immediately failed by osd.3 2023-07-20T15:03:16.212 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.517329+0000 mon.a (mon.0) 618 : cluster [DBG] osd.6 reported immediately failed by osd.0 2023-07-20T15:03:16.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.517529+0000 mon.a (mon.0) 619 : cluster [DBG] osd.6 reported immediately failed by osd.4 2023-07-20T15:03:16.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.517694+0000 mon.a (mon.0) 620 : cluster [DBG] osd.6 reported immediately failed by osd.1 2023-07-20T15:03:16.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.517838+0000 mon.a (mon.0) 621 : cluster [DBG] osd.6 reported immediately failed by osd.2 2023-07-20T15:03:16.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.517984+0000 mon.a (mon.0) 622 : cluster [DBG] osd.6 reported immediately failed by osd.3 2023-07-20T15:03:16.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.518174+0000 mon.a (mon.0) 623 : cluster [DBG] osd.6 reported immediately failed by osd.0 2023-07-20T15:03:16.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.518384+0000 mon.a (mon.0) 624 : cluster [DBG] osd.6 reported immediately failed by osd.5 2023-07-20T15:03:16.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.518545+0000 mon.a (mon.0) 625 : cluster [DBG] osd.6 reported immediately failed by osd.1 2023-07-20T15:03:16.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.518701+0000 mon.a (mon.0) 626 : cluster [DBG] osd.6 reported immediately failed by osd.2 2023-07-20T15:03:16.214 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:15 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.809067+0000 mgr.y (mgr.14142) 124 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 619 GiB / 626 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:03:16.337 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.315779+0000 mon.a (mon.0) 605 : cluster [DBG] osd.6 reported immediately failed by osd.3 2023-07-20T15:03:16.338 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.315847+0000 mon.a (mon.0) 606 : cluster [INF] osd.6 failed (root=default,host=smithi178) (connection refused reported by osd.3) 2023-07-20T15:03:16.338 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.316039+0000 mon.a (mon.0) 607 : cluster [DBG] osd.6 reported immediately failed by osd.3 2023-07-20T15:03:16.338 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.316146+0000 mon.a (mon.0) 608 : cluster [DBG] osd.6 reported immediately failed by osd.0 2023-07-20T15:03:16.338 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.316317+0000 mon.a (mon.0) 609 : cluster [DBG] osd.6 reported immediately failed by osd.1 2023-07-20T15:03:16.338 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.316371+0000 mon.a (mon.0) 610 : cluster [DBG] osd.6 reported immediately failed by osd.2 2023-07-20T15:03:16.338 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.316536+0000 mon.a (mon.0) 611 : cluster [DBG] osd.6 reported immediately failed by osd.0 2023-07-20T15:03:16.338 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.316626+0000 mon.a (mon.0) 612 : cluster [DBG] osd.6 reported immediately failed by osd.1 2023-07-20T15:03:16.339 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.316732+0000 mon.a (mon.0) 613 : cluster [DBG] osd.6 reported immediately failed by osd.2 2023-07-20T15:03:16.339 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.516487+0000 mon.a (mon.0) 614 : cluster [DBG] osd.6 reported immediately failed by osd.4 2023-07-20T15:03:16.339 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.516776+0000 mon.a (mon.0) 615 : cluster [DBG] osd.6 reported immediately failed by osd.5 2023-07-20T15:03:16.339 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.516877+0000 mon.a (mon.0) 616 : cluster [DBG] osd.6 reported immediately failed by osd.2 2023-07-20T15:03:16.339 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.517090+0000 mon.a (mon.0) 617 : cluster [DBG] osd.6 reported immediately failed by osd.3 2023-07-20T15:03:16.339 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.517329+0000 mon.a (mon.0) 618 : cluster [DBG] osd.6 reported immediately failed by osd.0 2023-07-20T15:03:16.339 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.517529+0000 mon.a (mon.0) 619 : cluster [DBG] osd.6 reported immediately failed by osd.4 2023-07-20T15:03:16.340 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.517694+0000 mon.a (mon.0) 620 : cluster [DBG] osd.6 reported immediately failed by osd.1 2023-07-20T15:03:16.340 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.517838+0000 mon.a (mon.0) 621 : cluster [DBG] osd.6 reported immediately failed by osd.2 2023-07-20T15:03:16.340 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.517984+0000 mon.a (mon.0) 622 : cluster [DBG] osd.6 reported immediately failed by osd.3 2023-07-20T15:03:16.351 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.518174+0000 mon.a (mon.0) 623 : cluster [DBG] osd.6 reported immediately failed by osd.0 2023-07-20T15:03:16.351 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.518384+0000 mon.a (mon.0) 624 : cluster [DBG] osd.6 reported immediately failed by osd.5 2023-07-20T15:03:16.351 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.518545+0000 mon.a (mon.0) 625 : cluster [DBG] osd.6 reported immediately failed by osd.1 2023-07-20T15:03:16.352 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.518701+0000 mon.a (mon.0) 626 : cluster [DBG] osd.6 reported immediately failed by osd.2 2023-07-20T15:03:16.352 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:15 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.809067+0000 mgr.y (mgr.14142) 124 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 619 GiB / 626 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:03:16.667 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:16 smithi178 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.6.service: Succeeded. 2023-07-20T15:03:16.668 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:16 smithi178 systemd[1]: Stopped Ceph osd.6 for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:03:16.668 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:16 smithi178 systemd[1]: Starting Ceph osd.6 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:03:16.668 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:16 smithi178 podman[113053]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.6" found: no such container 2023-07-20T15:03:16.668 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:16 smithi178 systemd[1]: Started Ceph osd.6 for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:03:17.234 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:16 smithi178 bash[113069]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-20T15:03:17.234 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:16 smithi178 bash[113069]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2023-07-20T15:03:17.234 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:16 smithi178 bash[113069]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2023-07-20T15:03:17.234 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:16 smithi178 bash[113069]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2023-07-20T15:03:17.235 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:16 smithi178 bash[113069]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-07-20T15:03:17.235 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:16 smithi178 bash[113069]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-20T15:03:17.235 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:16 smithi178 bash[113069]: --> ceph-volume lvm activate successful for osd ID: 6 2023-07-20T15:03:17.235 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:16 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.901758+0000 mon.a (mon.0) 627 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:03:17.235 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:16 smithi178 bash[104918]: cluster 2023-07-20T15:03:15.910839+0000 mon.a (mon.0) 628 : cluster [DBG] osdmap e55: 8 total, 6 up, 7 in 2023-07-20T15:03:17.236 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:16 smithi178 bash[104918]: audit 2023-07-20T15:03:15.911016+0000 mon.a (mon.0) 629 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:17.236 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:16 smithi178 bash[104918]: audit 2023-07-20T15:03:16.513824+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512179\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512289\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512330\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512366\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}}, \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:17.236 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:16 smithi178 bash[104918]: audit 2023-07-20T15:03:16.514321+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:17.236 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:16 smithi178 bash[104918]: audit 2023-07-20T15:03:16.517705+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512179\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512289\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512330\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512366\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}}, \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:17.236 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:16 smithi178 bash[104918]: audit 2023-07-20T15:03:16.519037+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-20T15:03:17.237 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:16 smithi178 bash[104918]: audit 2023-07-20T15:03:16.520336+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:17.237 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:16 smithi178 bash[104918]: cephadm 2023-07-20T15:03:16.520983+0000 mgr.y (mgr.14142) 125 : cephadm [INF] Deploying daemon osd.7 on smithi178 2023-07-20T15:03:17.237 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:16 smithi178 bash[104918]: audit 2023-07-20T15:03:16.521298+0000 mon.a (mon.0) 635 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2023-07-20T15:03:17.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.901758+0000 mon.a (mon.0) 627 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:03:17.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[104935]: cluster 2023-07-20T15:03:15.910839+0000 mon.a (mon.0) 628 : cluster [DBG] osdmap e55: 8 total, 6 up, 7 in 2023-07-20T15:03:17.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[104935]: audit 2023-07-20T15:03:15.911016+0000 mon.a (mon.0) 629 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:17.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.901758+0000 mon.a (mon.0) 627 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:03:17.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[108361]: cluster 2023-07-20T15:03:15.910839+0000 mon.a (mon.0) 628 : cluster [DBG] osdmap e55: 8 total, 6 up, 7 in 2023-07-20T15:03:17.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[108361]: audit 2023-07-20T15:03:15.911016+0000 mon.a (mon.0) 629 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:17.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[104935]: audit 2023-07-20T15:03:16.513824+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512179\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512289\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512330\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512366\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}}, \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:17.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[104935]: audit 2023-07-20T15:03:16.514321+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:17.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[108361]: audit 2023-07-20T15:03:16.513824+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512179\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512289\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512330\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512366\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}}, \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:17.458 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[108361]: audit 2023-07-20T15:03:16.514321+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:17.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[104935]: audit 2023-07-20T15:03:16.517705+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512179\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512289\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512330\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512366\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}}, \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:17.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[104935]: audit 2023-07-20T15:03:16.519037+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-20T15:03:17.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[104935]: audit 2023-07-20T15:03:16.520336+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:17.459 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[104935]: cephadm 2023-07-20T15:03:16.520983+0000 mgr.y (mgr.14142) 125 : cephadm [INF] Deploying daemon osd.7 on smithi178 2023-07-20T15:03:17.459 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[104935]: audit 2023-07-20T15:03:16.521298+0000 mon.a (mon.0) 635 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2023-07-20T15:03:17.459 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[108361]: audit 2023-07-20T15:03:16.517705+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512179\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512289\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512330\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:07.512366\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}}, \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:17.459 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[108361]: audit 2023-07-20T15:03:16.519037+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-20T15:03:17.459 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[108361]: audit 2023-07-20T15:03:16.520336+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:17.460 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[108361]: cephadm 2023-07-20T15:03:16.520983+0000 mgr.y (mgr.14142) 125 : cephadm [INF] Deploying daemon osd.7 on smithi178 2023-07-20T15:03:17.460 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:16 smithi029 bash[108361]: audit 2023-07-20T15:03:16.521298+0000 mon.a (mon.0) 635 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2023-07-20T15:03:18.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:17 smithi178 bash[104918]: cluster 2023-07-20T15:03:16.911782+0000 mon.a (mon.0) 636 : cluster [DBG] osdmap e56: 8 total, 6 up, 7 in 2023-07-20T15:03:18.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:17 smithi178 bash[104918]: audit 2023-07-20T15:03:16.911951+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:18.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:17 smithi178 bash[104918]: cluster 2023-07-20T15:03:17.809475+0000 mgr.y (mgr.14142) 126 : cluster [DBG] pgmap v135: 1 pgs: 1 stale+active+clean; 0 B data, 3.5 MiB used, 619 GiB / 626 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:03:18.364 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 6,7 on host 'smithi178' 2023-07-20T15:03:18.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:17 smithi029 bash[104935]: cluster 2023-07-20T15:03:16.911782+0000 mon.a (mon.0) 636 : cluster [DBG] osdmap e56: 8 total, 6 up, 7 in 2023-07-20T15:03:18.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:17 smithi029 bash[104935]: audit 2023-07-20T15:03:16.911951+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:18.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:17 smithi029 bash[104935]: cluster 2023-07-20T15:03:17.809475+0000 mgr.y (mgr.14142) 126 : cluster [DBG] pgmap v135: 1 pgs: 1 stale+active+clean; 0 B data, 3.5 MiB used, 619 GiB / 626 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:03:18.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:17 smithi029 bash[108361]: cluster 2023-07-20T15:03:16.911782+0000 mon.a (mon.0) 636 : cluster [DBG] osdmap e56: 8 total, 6 up, 7 in 2023-07-20T15:03:18.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:17 smithi029 bash[108361]: audit 2023-07-20T15:03:16.911951+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:18.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:17 smithi029 bash[108361]: cluster 2023-07-20T15:03:17.809475+0000 mgr.y (mgr.14142) 126 : cluster [DBG] pgmap v135: 1 pgs: 1 stale+active+clean; 0 B data, 3.5 MiB used, 619 GiB / 626 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-07-20T15:03:18.669 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:18 smithi178 bash[113296]: debug 2023-07-20T15:03:18.357+0000 7f30730c5ec0 -1 Falling back to public interface 2023-07-20T15:03:18.805 DEBUG:teuthology.orchestra.run.smithi178:osd.7> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.7.service 2023-07-20T15:03:18.827 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2023-07-20T15:03:18.827 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph osd stat -f json 2023-07-20T15:03:18.860 INFO:journalctl@ceph.osd.7.smithi178.stdout:-- Logs begin at Thu 2023-07-20 14:49:59 UTC. -- 2023-07-20T15:03:19.150 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:18 smithi029 bash[104935]: audit 2023-07-20T15:03:18.053599+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052538\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052634\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052675\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052711\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052746\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}}, \"last_daemon_update\": \"2023-07-20T15:03:18.052842\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:19.151 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:18 smithi029 bash[104935]: audit 2023-07-20T15:03:18.056665+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052538\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052634\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052675\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052711\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052746\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}}, \"last_daemon_update\": \"2023-07-20T15:03:18.052842\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:19.151 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:18 smithi029 bash[104935]: audit 2023-07-20T15:03:18.313734+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052538\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052634\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052675\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052711\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052746\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:19.151 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:18 smithi029 bash[104935]: audit 2023-07-20T15:03:18.314134+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:19.152 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:18 smithi029 bash[108361]: audit 2023-07-20T15:03:18.053599+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052538\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052634\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052675\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052711\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052746\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}}, \"last_daemon_update\": \"2023-07-20T15:03:18.052842\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:19.152 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:18 smithi029 bash[108361]: audit 2023-07-20T15:03:18.056665+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052538\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052634\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052675\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052711\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052746\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}}, \"last_daemon_update\": \"2023-07-20T15:03:18.052842\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:19.165 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:18 smithi029 bash[104935]: audit 2023-07-20T15:03:18.317352+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052538\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052634\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052675\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052711\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052746\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:19.166 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:18 smithi029 bash[108361]: audit 2023-07-20T15:03:18.313734+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052538\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052634\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052675\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052711\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052746\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:19.166 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:18 smithi029 bash[108361]: audit 2023-07-20T15:03:18.314134+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:19.166 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:18 smithi029 bash[108361]: audit 2023-07-20T15:03:18.317352+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052538\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052634\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052675\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052711\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052746\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:19.168 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:18 smithi178 bash[113296]: debug 2023-07-20T15:03:18.933+0000 7f30730c5ec0 -1 osd.6 54 log_to_monitors {default=true} 2023-07-20T15:03:19.169 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:03:18 smithi178 bash[113296]: debug 2023-07-20T15:03:18.943+0000 7f3067096700 -1 osd.6 54 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2023-07-20T15:03:19.169 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:03:18 smithi178 bash[113514]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-20T15:03:19.170 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:03:18 smithi178 bash[113514]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2023-07-20T15:03:19.170 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:03:18 smithi178 bash[113514]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2023-07-20T15:03:19.170 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:03:18 smithi178 bash[113514]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2023-07-20T15:03:19.170 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:03:18 smithi178 bash[113514]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2023-07-20T15:03:19.170 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:03:18 smithi178 bash[113514]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-20T15:03:19.170 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:03:18 smithi178 bash[113514]: --> ceph-volume lvm activate successful for osd ID: 7 2023-07-20T15:03:19.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:18 smithi178 bash[104918]: audit 2023-07-20T15:03:18.053599+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052538\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052634\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052675\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052711\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052746\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}}, \"last_daemon_update\": \"2023-07-20T15:03:18.052842\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:19.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:18 smithi178 bash[104918]: audit 2023-07-20T15:03:18.056665+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052538\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052634\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052675\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052711\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052746\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}}, \"last_daemon_update\": \"2023-07-20T15:03:18.052842\", \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:19.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:18 smithi178 bash[104918]: audit 2023-07-20T15:03:18.313734+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052538\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052634\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052675\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052711\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052746\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:19.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:18 smithi178 bash[104918]: audit 2023-07-20T15:03:18.314134+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:19.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:18 smithi178 bash[104918]: audit 2023-07-20T15:03:18.317352+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052538\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052634\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052675\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052711\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:18.052746\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_device_update\": \"2023-07-20T15:03:06.260021\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:19.994 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T15:03:20.238 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:03:20 smithi178 bash[113811]: debug 2023-07-20T15:03:20.133+0000 7fe688795ec0 -1 Falling back to public interface 2023-07-20T15:03:20.239 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:19 smithi178 bash[104918]: audit 2023-07-20T15:03:18.937920+0000 mon.c (mon.1) 18 : audit [INF] from='osd.6 [v2:172.21.15.178:6816/3503656327,v1:172.21.15.178:6817/3503656327]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-20T15:03:20.239 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:19 smithi178 bash[104918]: audit 2023-07-20T15:03:18.938213+0000 mon.a (mon.0) 643 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-20T15:03:20.240 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:19 smithi178 bash[104918]: audit 2023-07-20T15:03:18.939665+0000 mon.c (mon.1) 19 : audit [INF] from='osd.6 [v2:172.21.15.178:6816/3503656327,v1:172.21.15.178:6817/3503656327]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:20.240 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:19 smithi178 bash[104918]: audit 2023-07-20T15:03:18.939876+0000 mon.a (mon.0) 644 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:20.240 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:19 smithi178 bash[104918]: cluster 2023-07-20T15:03:19.809832+0000 mgr.y (mgr.14142) 127 : cluster [DBG] pgmap v136: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.7 MiB used, 619 GiB / 626 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:20.240 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:19 smithi178 bash[104918]: audit 2023-07-20T15:03:19.848083+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_daemon_update\": \"2023-07-20T15:03:19.847480\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:20.240 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:19 smithi178 bash[104918]: audit 2023-07-20T15:03:19.850648+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_daemon_update\": \"2023-07-20T15:03:19.847480\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:20.241 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:19 smithi178 bash[104918]: audit 2023-07-20T15:03:19.851138+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:03:20.282 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:19 smithi029 bash[104935]: audit 2023-07-20T15:03:18.937920+0000 mon.c (mon.1) 18 : audit [INF] from='osd.6 [v2:172.21.15.178:6816/3503656327,v1:172.21.15.178:6817/3503656327]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-20T15:03:20.282 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:19 smithi029 bash[104935]: audit 2023-07-20T15:03:18.938213+0000 mon.a (mon.0) 643 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-20T15:03:20.282 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:19 smithi029 bash[104935]: audit 2023-07-20T15:03:18.939665+0000 mon.c (mon.1) 19 : audit [INF] from='osd.6 [v2:172.21.15.178:6816/3503656327,v1:172.21.15.178:6817/3503656327]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:20.282 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:19 smithi029 bash[104935]: audit 2023-07-20T15:03:18.939876+0000 mon.a (mon.0) 644 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:20.283 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:19 smithi029 bash[104935]: cluster 2023-07-20T15:03:19.809832+0000 mgr.y (mgr.14142) 127 : cluster [DBG] pgmap v136: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.7 MiB used, 619 GiB / 626 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:20.284 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:19 smithi029 bash[108361]: audit 2023-07-20T15:03:18.937920+0000 mon.c (mon.1) 18 : audit [INF] from='osd.6 [v2:172.21.15.178:6816/3503656327,v1:172.21.15.178:6817/3503656327]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-20T15:03:20.284 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:19 smithi029 bash[108361]: audit 2023-07-20T15:03:18.938213+0000 mon.a (mon.0) 643 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-20T15:03:20.285 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:19 smithi029 bash[108361]: audit 2023-07-20T15:03:18.939665+0000 mon.c (mon.1) 19 : audit [INF] from='osd.6 [v2:172.21.15.178:6816/3503656327,v1:172.21.15.178:6817/3503656327]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:20.285 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:19 smithi029 bash[108361]: audit 2023-07-20T15:03:18.939876+0000 mon.a (mon.0) 644 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:20.285 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:19 smithi029 bash[108361]: cluster 2023-07-20T15:03:19.809832+0000 mgr.y (mgr.14142) 127 : cluster [DBG] pgmap v136: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.7 MiB used, 619 GiB / 626 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:20.285 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:19 smithi029 bash[104935]: audit 2023-07-20T15:03:19.848083+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_daemon_update\": \"2023-07-20T15:03:19.847480\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:20.286 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:19 smithi029 bash[104935]: audit 2023-07-20T15:03:19.850648+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_daemon_update\": \"2023-07-20T15:03:19.847480\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:20.286 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:19 smithi029 bash[104935]: audit 2023-07-20T15:03:19.851138+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:03:20.286 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:19 smithi029 bash[108361]: audit 2023-07-20T15:03:19.848083+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_daemon_update\": \"2023-07-20T15:03:19.847480\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:20.287 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:19 smithi029 bash[108361]: audit 2023-07-20T15:03:19.850648+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_daemon_update\": \"2023-07-20T15:03:19.847480\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:20.287 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:19 smithi029 bash[108361]: audit 2023-07-20T15:03:19.851138+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2023-07-20T15:03:20.354 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":57,"num_osds":8,"num_up_osds":7,"osd_up_since":1689865399,"num_in_osds":7,"osd_in_since":1689865387,"num_remapped_pgs":0} 2023-07-20T15:03:20.972 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:03:20 smithi178 bash[113811]: debug 2023-07-20T15:03:20.693+0000 7fe688795ec0 -1 osd.7 0 log_to_monitors {default=true} 2023-07-20T15:03:21.362 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph osd stat -f json 2023-07-20T15:03:21.401 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[108361]: cluster 2023-07-20T15:03:19.916365+0000 mon.a (mon.0) 648 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:03:21.401 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[108361]: cluster 2023-07-20T15:03:19.916395+0000 mon.a (mon.0) 649 : cluster [INF] Cluster is now healthy 2023-07-20T15:03:21.401 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[108361]: cluster 2023-07-20T15:03:19.919763+0000 mon.a (mon.0) 650 : cluster [INF] osd.6 [v2:172.21.15.178:6816/3503656327,v1:172.21.15.178:6817/3503656327] boot 2023-07-20T15:03:21.401 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[108361]: cluster 2023-07-20T15:03:19.919811+0000 mon.a (mon.0) 651 : cluster [DBG] osdmap e57: 8 total, 7 up, 7 in 2023-07-20T15:03:21.402 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[108361]: audit 2023-07-20T15:03:19.920335+0000 mon.a (mon.0) 652 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:21.402 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[108361]: audit 2023-07-20T15:03:19.920693+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:21.402 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[108361]: audit 2023-07-20T15:03:19.945253+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.29:0/890686188' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-20T15:03:21.410 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[108361]: audit 2023-07-20T15:03:20.697442+0000 mon.c (mon.1) 21 : audit [INF] from='osd.7 [v2:172.21.15.178:6824/3700445879,v1:172.21.15.178:6825/3700445879]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-20T15:03:21.410 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[108361]: audit 2023-07-20T15:03:20.697771+0000 mon.a (mon.0) 654 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-20T15:03:21.410 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[108361]: cluster 2023-07-20T15:03:20.808066+0000 mon.a (mon.0) 655 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-07-20T15:03:21.411 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[104935]: cluster 2023-07-20T15:03:19.916365+0000 mon.a (mon.0) 648 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:03:21.411 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[104935]: cluster 2023-07-20T15:03:19.916395+0000 mon.a (mon.0) 649 : cluster [INF] Cluster is now healthy 2023-07-20T15:03:21.411 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[104935]: cluster 2023-07-20T15:03:19.919763+0000 mon.a (mon.0) 650 : cluster [INF] osd.6 [v2:172.21.15.178:6816/3503656327,v1:172.21.15.178:6817/3503656327] boot 2023-07-20T15:03:21.411 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[104935]: cluster 2023-07-20T15:03:19.919811+0000 mon.a (mon.0) 651 : cluster [DBG] osdmap e57: 8 total, 7 up, 7 in 2023-07-20T15:03:21.412 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[104935]: audit 2023-07-20T15:03:19.920335+0000 mon.a (mon.0) 652 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:21.412 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[104935]: audit 2023-07-20T15:03:19.920693+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:21.412 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[104935]: audit 2023-07-20T15:03:19.945253+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.29:0/890686188' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-20T15:03:21.412 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[104935]: audit 2023-07-20T15:03:20.697442+0000 mon.c (mon.1) 21 : audit [INF] from='osd.7 [v2:172.21.15.178:6824/3700445879,v1:172.21.15.178:6825/3700445879]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-20T15:03:21.412 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[104935]: audit 2023-07-20T15:03:20.697771+0000 mon.a (mon.0) 654 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-20T15:03:21.436 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:20 smithi029 bash[104935]: cluster 2023-07-20T15:03:20.808066+0000 mon.a (mon.0) 655 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-07-20T15:03:21.436 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:20 smithi178 bash[104918]: cluster 2023-07-20T15:03:19.916365+0000 mon.a (mon.0) 648 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:03:21.437 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:20 smithi178 bash[104918]: cluster 2023-07-20T15:03:19.916395+0000 mon.a (mon.0) 649 : cluster [INF] Cluster is now healthy 2023-07-20T15:03:21.437 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:20 smithi178 bash[104918]: cluster 2023-07-20T15:03:19.919763+0000 mon.a (mon.0) 650 : cluster [INF] osd.6 [v2:172.21.15.178:6816/3503656327,v1:172.21.15.178:6817/3503656327] boot 2023-07-20T15:03:21.437 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:20 smithi178 bash[104918]: cluster 2023-07-20T15:03:19.919811+0000 mon.a (mon.0) 651 : cluster [DBG] osdmap e57: 8 total, 7 up, 7 in 2023-07-20T15:03:21.437 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:20 smithi178 bash[104918]: audit 2023-07-20T15:03:19.920335+0000 mon.a (mon.0) 652 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:03:21.437 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:20 smithi178 bash[104918]: audit 2023-07-20T15:03:19.920693+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:21.437 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:20 smithi178 bash[104918]: audit 2023-07-20T15:03:19.945253+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.29:0/890686188' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-20T15:03:21.437 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:20 smithi178 bash[104918]: audit 2023-07-20T15:03:20.697442+0000 mon.c (mon.1) 21 : audit [INF] from='osd.7 [v2:172.21.15.178:6824/3700445879,v1:172.21.15.178:6825/3700445879]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-20T15:03:21.438 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:20 smithi178 bash[104918]: audit 2023-07-20T15:03:20.697771+0000 mon.a (mon.0) 654 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-20T15:03:21.438 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:20 smithi178 bash[104918]: cluster 2023-07-20T15:03:20.808066+0000 mon.a (mon.0) 655 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-07-20T15:03:22.081 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:21 smithi029 bash[104935]: audit 2023-07-20T15:03:20.924951+0000 mon.a (mon.0) 656 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-07-20T15:03:22.081 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:21 smithi029 bash[104935]: cluster 2023-07-20T15:03:20.925004+0000 mon.a (mon.0) 657 : cluster [DBG] osdmap e58: 8 total, 7 up, 7 in 2023-07-20T15:03:22.081 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:21 smithi029 bash[104935]: audit 2023-07-20T15:03:20.925614+0000 mon.a (mon.0) 658 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:22.081 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:21 smithi029 bash[104935]: audit 2023-07-20T15:03:20.926341+0000 mon.c (mon.1) 22 : audit [INF] from='osd.7 [v2:172.21.15.178:6824/3700445879,v1:172.21.15.178:6825/3700445879]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:22.081 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:21 smithi029 bash[104935]: audit 2023-07-20T15:03:20.931221+0000 mon.a (mon.0) 659 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:22.082 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:21 smithi029 bash[104935]: cluster 2023-07-20T15:03:21.664118+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:03:22.082 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:21 smithi029 bash[104935]: cluster 2023-07-20T15:03:21.664191+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:03:22.082 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:21 smithi029 bash[104935]: cluster 2023-07-20T15:03:21.810312+0000 mgr.y (mgr.14142) 128 : cluster [DBG] pgmap v139: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.7 MiB used, 619 GiB / 626 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:22.082 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:21 smithi029 bash[108361]: audit 2023-07-20T15:03:20.924951+0000 mon.a (mon.0) 656 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-07-20T15:03:22.082 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:21 smithi029 bash[108361]: cluster 2023-07-20T15:03:20.925004+0000 mon.a (mon.0) 657 : cluster [DBG] osdmap e58: 8 total, 7 up, 7 in 2023-07-20T15:03:22.082 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:21 smithi029 bash[108361]: audit 2023-07-20T15:03:20.925614+0000 mon.a (mon.0) 658 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:22.091 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:21 smithi029 bash[108361]: audit 2023-07-20T15:03:20.926341+0000 mon.c (mon.1) 22 : audit [INF] from='osd.7 [v2:172.21.15.178:6824/3700445879,v1:172.21.15.178:6825/3700445879]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:22.091 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:21 smithi029 bash[108361]: audit 2023-07-20T15:03:20.931221+0000 mon.a (mon.0) 659 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:22.091 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:21 smithi029 bash[108361]: cluster 2023-07-20T15:03:21.664118+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:03:22.091 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:21 smithi029 bash[108361]: cluster 2023-07-20T15:03:21.664191+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:03:22.092 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:21 smithi029 bash[108361]: cluster 2023-07-20T15:03:21.810312+0000 mgr.y (mgr.14142) 128 : cluster [DBG] pgmap v139: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.7 MiB used, 619 GiB / 626 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:22.420 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:03:21 smithi178 bash[113811]: debug 2023-07-20T15:03:21.935+0000 7fe66d542700 -1 osd.7 0 waiting for initial osdmap 2023-07-20T15:03:22.420 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:03:21 smithi178 bash[113811]: debug 2023-07-20T15:03:21.943+0000 7fe67875e700 -1 osd.7 59 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2023-07-20T15:03:22.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:21 smithi178 bash[104918]: audit 2023-07-20T15:03:20.924951+0000 mon.a (mon.0) 656 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-07-20T15:03:22.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:21 smithi178 bash[104918]: cluster 2023-07-20T15:03:20.925004+0000 mon.a (mon.0) 657 : cluster [DBG] osdmap e58: 8 total, 7 up, 7 in 2023-07-20T15:03:22.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:21 smithi178 bash[104918]: audit 2023-07-20T15:03:20.925614+0000 mon.a (mon.0) 658 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:22.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:21 smithi178 bash[104918]: audit 2023-07-20T15:03:20.926341+0000 mon.c (mon.1) 22 : audit [INF] from='osd.7 [v2:172.21.15.178:6824/3700445879,v1:172.21.15.178:6825/3700445879]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:22.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:21 smithi178 bash[104918]: audit 2023-07-20T15:03:20.931221+0000 mon.a (mon.0) 659 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-07-20T15:03:22.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:21 smithi178 bash[104918]: cluster 2023-07-20T15:03:21.664118+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2023-07-20T15:03:22.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:21 smithi178 bash[104918]: cluster 2023-07-20T15:03:21.664191+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2023-07-20T15:03:22.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:21 smithi178 bash[104918]: cluster 2023-07-20T15:03:21.810312+0000 mgr.y (mgr.14142) 128 : cluster [DBG] pgmap v139: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.7 MiB used, 619 GiB / 626 GiB avail; 1/3 objects degraded (33.333%) 2023-07-20T15:03:22.549 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T15:03:22.871 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":59,"num_osds":8,"num_up_osds":7,"osd_up_since":1689865399,"num_in_osds":7,"osd_in_since":1689865387,"num_remapped_pgs":0} 2023-07-20T15:03:23.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:22 smithi029 bash[104935]: audit 2023-07-20T15:03:21.927988+0000 mon.a (mon.0) 660 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:23.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:22 smithi029 bash[104935]: audit 2023-07-20T15:03:21.930700+0000 mon.a (mon.0) 661 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-07-20T15:03:23.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:22 smithi029 bash[104935]: cluster 2023-07-20T15:03:21.930754+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e59: 8 total, 7 up, 7 in 2023-07-20T15:03:23.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:22 smithi029 bash[104935]: audit 2023-07-20T15:03:21.931356+0000 mon.a (mon.0) 663 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:23.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:22 smithi029 bash[108361]: audit 2023-07-20T15:03:21.927988+0000 mon.a (mon.0) 660 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:23.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:22 smithi029 bash[108361]: audit 2023-07-20T15:03:21.930700+0000 mon.a (mon.0) 661 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-07-20T15:03:23.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:22 smithi029 bash[108361]: cluster 2023-07-20T15:03:21.930754+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e59: 8 total, 7 up, 7 in 2023-07-20T15:03:23.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:22 smithi029 bash[108361]: audit 2023-07-20T15:03:21.931356+0000 mon.a (mon.0) 663 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:23.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:22 smithi029 bash[104935]: audit 2023-07-20T15:03:22.113474+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_daemon_update\": \"2023-07-20T15:03:19.847480\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:23.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:22 smithi029 bash[104935]: audit 2023-07-20T15:03:22.116206+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_daemon_update\": \"2023-07-20T15:03:19.847480\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:23.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:22 smithi029 bash[104935]: audit 2023-07-20T15:03:22.505196+0000 mon.a (mon.0) 666 : audit [DBG] from='client.? 172.21.15.29:0/475500041' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-20T15:03:23.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:22 smithi029 bash[108361]: audit 2023-07-20T15:03:22.113474+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_daemon_update\": \"2023-07-20T15:03:19.847480\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:23.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:22 smithi029 bash[108361]: audit 2023-07-20T15:03:22.116206+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_daemon_update\": \"2023-07-20T15:03:19.847480\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:23.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:22 smithi029 bash[108361]: audit 2023-07-20T15:03:22.505196+0000 mon.a (mon.0) 666 : audit [DBG] from='client.? 172.21.15.29:0/475500041' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-20T15:03:23.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:22 smithi178 bash[104918]: audit 2023-07-20T15:03:21.927988+0000 mon.a (mon.0) 660 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:23.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:22 smithi178 bash[104918]: audit 2023-07-20T15:03:21.930700+0000 mon.a (mon.0) 661 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-07-20T15:03:23.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:22 smithi178 bash[104918]: cluster 2023-07-20T15:03:21.930754+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e59: 8 total, 7 up, 7 in 2023-07-20T15:03:23.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:22 smithi178 bash[104918]: audit 2023-07-20T15:03:21.931356+0000 mon.a (mon.0) 663 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:23.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:22 smithi178 bash[104918]: audit 2023-07-20T15:03:22.113474+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_daemon_update\": \"2023-07-20T15:03:19.847480\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:23.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:22 smithi178 bash[104918]: audit 2023-07-20T15:03:22.116206+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}}, \"last_daemon_update\": \"2023-07-20T15:03:19.847480\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:23.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:22 smithi178 bash[104918]: audit 2023-07-20T15:03:22.505196+0000 mon.a (mon.0) 666 : audit [DBG] from='client.? 172.21.15.29:0/475500041' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-20T15:03:23.873 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph osd stat -f json 2023-07-20T15:03:24.185 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:23 smithi029 bash[104935]: cluster 2023-07-20T15:03:22.936506+0000 mon.a (mon.0) 667 : cluster [INF] osd.7 [v2:172.21.15.178:6824/3700445879,v1:172.21.15.178:6825/3700445879] boot 2023-07-20T15:03:24.185 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:23 smithi029 bash[104935]: cluster 2023-07-20T15:03:22.936558+0000 mon.a (mon.0) 668 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2023-07-20T15:03:24.185 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:23 smithi029 bash[104935]: audit 2023-07-20T15:03:22.937073+0000 mon.a (mon.0) 669 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:24.185 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:23 smithi029 bash[104935]: cluster 2023-07-20T15:03:23.810850+0000 mgr.y (mgr.14142) 129 : cluster [DBG] pgmap v142: 1 pgs: 1 peering; 0 B data, 4.4 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:24.186 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:23 smithi029 bash[108361]: cluster 2023-07-20T15:03:22.936506+0000 mon.a (mon.0) 667 : cluster [INF] osd.7 [v2:172.21.15.178:6824/3700445879,v1:172.21.15.178:6825/3700445879] boot 2023-07-20T15:03:24.186 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:23 smithi029 bash[108361]: cluster 2023-07-20T15:03:22.936558+0000 mon.a (mon.0) 668 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2023-07-20T15:03:24.186 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:23 smithi029 bash[108361]: audit 2023-07-20T15:03:22.937073+0000 mon.a (mon.0) 669 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:24.186 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:23 smithi029 bash[108361]: cluster 2023-07-20T15:03:23.810850+0000 mgr.y (mgr.14142) 129 : cluster [DBG] pgmap v142: 1 pgs: 1 peering; 0 B data, 4.4 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:24.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:23 smithi178 bash[104918]: cluster 2023-07-20T15:03:22.936506+0000 mon.a (mon.0) 667 : cluster [INF] osd.7 [v2:172.21.15.178:6824/3700445879,v1:172.21.15.178:6825/3700445879] boot 2023-07-20T15:03:24.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:23 smithi178 bash[104918]: cluster 2023-07-20T15:03:22.936558+0000 mon.a (mon.0) 668 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2023-07-20T15:03:24.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:23 smithi178 bash[104918]: audit 2023-07-20T15:03:22.937073+0000 mon.a (mon.0) 669 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:03:24.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:23 smithi178 bash[104918]: cluster 2023-07-20T15:03:23.810850+0000 mgr.y (mgr.14142) 129 : cluster [DBG] pgmap v142: 1 pgs: 1 peering; 0 B data, 4.4 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:25.063 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T15:03:25.243 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:24 smithi029 bash[104935]: cluster 2023-07-20T15:03:23.938371+0000 mon.a (mon.0) 670 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2023-07-20T15:03:25.243 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:24 smithi029 bash[104935]: cluster 2023-07-20T15:03:23.938401+0000 mon.a (mon.0) 671 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2023-07-20T15:03:25.243 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:24 smithi029 bash[104935]: cluster 2023-07-20T15:03:23.946276+0000 mon.a (mon.0) 672 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2023-07-20T15:03:25.243 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:24 smithi029 bash[108361]: cluster 2023-07-20T15:03:23.938371+0000 mon.a (mon.0) 670 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2023-07-20T15:03:25.244 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:24 smithi029 bash[108361]: cluster 2023-07-20T15:03:23.938401+0000 mon.a (mon.0) 671 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2023-07-20T15:03:25.244 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:24 smithi029 bash[108361]: cluster 2023-07-20T15:03:23.946276+0000 mon.a (mon.0) 672 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2023-07-20T15:03:25.419 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:24 smithi178 bash[104918]: cluster 2023-07-20T15:03:23.938371+0000 mon.a (mon.0) 670 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2023-07-20T15:03:25.419 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:24 smithi178 bash[104918]: cluster 2023-07-20T15:03:23.938401+0000 mon.a (mon.0) 671 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2023-07-20T15:03:25.419 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:24 smithi178 bash[104918]: cluster 2023-07-20T15:03:23.946276+0000 mon.a (mon.0) 672 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2023-07-20T15:03:25.437 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":61,"num_osds":8,"num_up_osds":8,"osd_up_since":1689865402,"num_in_osds":8,"osd_in_since":1689865402,"num_remapped_pgs":0} 2023-07-20T15:03:25.440 INFO:tasks.cephadm:Adding prometheus.a on smithi178 2023-07-20T15:03:25.441 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph orch apply prometheus '1;smithi178=a' 2023-07-20T15:03:26.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:25 smithi178 bash[104918]: audit 2023-07-20T15:03:25.017779+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.29:0/468424860' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-20T15:03:26.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:25 smithi178 bash[104918]: cluster 2023-07-20T15:03:25.811225+0000 mgr.y (mgr.14142) 130 : cluster [DBG] pgmap v144: 1 pgs: 1 peering; 0 B data, 4.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:26.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:25 smithi029 bash[104935]: audit 2023-07-20T15:03:25.017779+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.29:0/468424860' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-20T15:03:26.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:25 smithi029 bash[104935]: cluster 2023-07-20T15:03:25.811225+0000 mgr.y (mgr.14142) 130 : cluster [DBG] pgmap v144: 1 pgs: 1 peering; 0 B data, 4.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:26.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:25 smithi029 bash[108361]: audit 2023-07-20T15:03:25.017779+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.29:0/468424860' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-20T15:03:26.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:25 smithi029 bash[108361]: cluster 2023-07-20T15:03:25.811225+0000 mgr.y (mgr.14142) 130 : cluster [DBG] pgmap v144: 1 pgs: 1 peering; 0 B data, 4.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:26.735 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled prometheus update... 2023-07-20T15:03:27.122 DEBUG:teuthology.orchestra.run.smithi178:prometheus.a> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@prometheus.a.service 2023-07-20T15:03:27.135 INFO:tasks.cephadm:Adding node-exporter.a on smithi029 2023-07-20T15:03:27.135 INFO:tasks.cephadm:Adding node-exporter.b on smithi178 2023-07-20T15:03:27.136 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph orch apply node-exporter '2;smithi029=a;smithi178=b' 2023-07-20T15:03:27.162 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:-- Logs begin at Thu 2023-07-20 14:49:59 UTC. -- 2023-07-20T15:03:27.389 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:26 smithi178 bash[104918]: audit 2023-07-20T15:03:26.682512+0000 mgr.y (mgr.14142) 131 : audit [DBG] from='client.34349 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi178=a", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:03:27.389 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:26 smithi178 bash[104918]: cephadm 2023-07-20T15:03:26.683115+0000 mgr.y (mgr.14142) 132 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi178=a 2023-07-20T15:03:27.390 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:26 smithi178 bash[104918]: audit 2023-07-20T15:03:26.683526+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2023-07-20T15:03:26.683131\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi178\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2023-07-20T15:03:27.390 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:26 smithi178 bash[104918]: audit 2023-07-20T15:03:26.686662+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2023-07-20T15:03:26.683131\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi178\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2023-07-20T15:03:27.390 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:26 smithi178 bash[104918]: cephadm 2023-07-20T15:03:26.690793+0000 mgr.y (mgr.14142) 133 : cephadm [INF] Deploying daemon prometheus.a on smithi178 2023-07-20T15:03:27.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:26 smithi029 bash[104935]: audit 2023-07-20T15:03:26.682512+0000 mgr.y (mgr.14142) 131 : audit [DBG] from='client.34349 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi178=a", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:03:27.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:26 smithi029 bash[104935]: cephadm 2023-07-20T15:03:26.683115+0000 mgr.y (mgr.14142) 132 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi178=a 2023-07-20T15:03:27.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:26 smithi029 bash[104935]: audit 2023-07-20T15:03:26.683526+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2023-07-20T15:03:26.683131\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi178\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2023-07-20T15:03:27.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:26 smithi029 bash[104935]: audit 2023-07-20T15:03:26.686662+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2023-07-20T15:03:26.683131\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi178\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2023-07-20T15:03:27.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:26 smithi029 bash[104935]: cephadm 2023-07-20T15:03:26.690793+0000 mgr.y (mgr.14142) 133 : cephadm [INF] Deploying daemon prometheus.a on smithi178 2023-07-20T15:03:27.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:26 smithi029 bash[108361]: audit 2023-07-20T15:03:26.682512+0000 mgr.y (mgr.14142) 131 : audit [DBG] from='client.34349 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi178=a", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:03:27.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:26 smithi029 bash[108361]: cephadm 2023-07-20T15:03:26.683115+0000 mgr.y (mgr.14142) 132 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi178=a 2023-07-20T15:03:27.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:26 smithi029 bash[108361]: audit 2023-07-20T15:03:26.683526+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2023-07-20T15:03:26.683131\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi178\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2023-07-20T15:03:27.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:26 smithi029 bash[108361]: audit 2023-07-20T15:03:26.686662+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2023-07-20T15:03:26.683131\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi178\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2023-07-20T15:03:27.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:26 smithi029 bash[108361]: cephadm 2023-07-20T15:03:26.690793+0000 mgr.y (mgr.14142) 133 : cephadm [INF] Deploying daemon prometheus.a on smithi178 2023-07-20T15:03:28.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:27 smithi178 bash[104918]: cluster 2023-07-20T15:03:27.811546+0000 mgr.y (mgr.14142) 134 : cluster [DBG] pgmap v145: 1 pgs: 1 peering; 0 B data, 4.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:28.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:27 smithi029 bash[104935]: cluster 2023-07-20T15:03:27.811546+0000 mgr.y (mgr.14142) 134 : cluster [DBG] pgmap v145: 1 pgs: 1 peering; 0 B data, 4.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:28.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:27 smithi029 bash[108361]: cluster 2023-07-20T15:03:27.811546+0000 mgr.y (mgr.14142) 134 : cluster [DBG] pgmap v145: 1 pgs: 1 peering; 0 B data, 4.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:29.073 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled node-exporter update... 2023-07-20T15:03:29.419 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:29 smithi178 bash[104918]: audit 2023-07-20T15:03:29.021592+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2023-07-20T15:03:29.021227\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi178\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2023-07-20T15:03:29.419 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:29 smithi178 bash[104918]: audit 2023-07-20T15:03:29.024634+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2023-07-20T15:03:29.021227\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi178\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2023-07-20T15:03:29.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:29 smithi029 bash[104935]: audit 2023-07-20T15:03:29.021592+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2023-07-20T15:03:29.021227\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi178\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2023-07-20T15:03:29.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:29 smithi029 bash[104935]: audit 2023-07-20T15:03:29.024634+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2023-07-20T15:03:29.021227\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi178\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2023-07-20T15:03:29.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:29 smithi029 bash[108361]: audit 2023-07-20T15:03:29.021592+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2023-07-20T15:03:29.021227\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi178\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2023-07-20T15:03:29.449 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:29 smithi029 bash[108361]: audit 2023-07-20T15:03:29.024634+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2023-07-20T15:03:29.021227\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi178\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2023-07-20T15:03:30.678 DEBUG:teuthology.orchestra.run.smithi029:node-exporter.a> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@node-exporter.a.service 2023-07-20T15:03:30.682 DEBUG:teuthology.orchestra.run.smithi178:node-exporter.b> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@node-exporter.b.service 2023-07-20T15:03:30.685 INFO:tasks.cephadm:Adding alertmanager.a on smithi029 2023-07-20T15:03:30.686 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph orch apply alertmanager '1;smithi029=a' 2023-07-20T15:03:30.716 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:-- Logs begin at Thu 2023-07-20 14:49:59 UTC. -- 2023-07-20T15:03:30.723 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:-- Logs begin at Thu 2023-07-20 14:49:36 UTC. -- 2023-07-20T15:03:30.919 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:30 smithi178 bash[104918]: audit 2023-07-20T15:03:29.020653+0000 mgr.y (mgr.14142) 135 : audit [DBG] from='client.34355 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi029=a;smithi178=b", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:03:30.919 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:30 smithi178 bash[104918]: cephadm 2023-07-20T15:03:29.021211+0000 mgr.y (mgr.14142) 136 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi029=a,smithi178=b 2023-07-20T15:03:30.919 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:30 smithi178 bash[104918]: cluster 2023-07-20T15:03:29.811932+0000 mgr.y (mgr.14142) 137 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:31.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:30 smithi029 bash[104935]: audit 2023-07-20T15:03:29.020653+0000 mgr.y (mgr.14142) 135 : audit [DBG] from='client.34355 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi029=a;smithi178=b", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:03:31.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:30 smithi029 bash[104935]: cephadm 2023-07-20T15:03:29.021211+0000 mgr.y (mgr.14142) 136 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi029=a,smithi178=b 2023-07-20T15:03:31.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:30 smithi029 bash[104935]: cluster 2023-07-20T15:03:29.811932+0000 mgr.y (mgr.14142) 137 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:31.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:30 smithi029 bash[108361]: audit 2023-07-20T15:03:29.020653+0000 mgr.y (mgr.14142) 135 : audit [DBG] from='client.34355 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi029=a;smithi178=b", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:03:31.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:30 smithi029 bash[108361]: cephadm 2023-07-20T15:03:29.021211+0000 mgr.y (mgr.14142) 136 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi029=a,smithi178=b 2023-07-20T15:03:31.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:30 smithi029 bash[108361]: cluster 2023-07-20T15:03:29.811932+0000 mgr.y (mgr.14142) 137 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:32.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:31 smithi178 bash[104918]: cluster 2023-07-20T15:03:30.809930+0000 mon.a (mon.0) 677 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2023-07-20T15:03:32.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:31 smithi178 bash[104918]: cluster 2023-07-20T15:03:30.810012+0000 mon.a (mon.0) 678 : cluster [INF] Cluster is now healthy 2023-07-20T15:03:32.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:31 smithi178 bash[104918]: audit 2023-07-20T15:03:30.826307+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"c4023cd1-27fa-43bb-af46-790b726ab8f7\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1689865402.936293, \"finished_at\": 1689865410.8149052}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2023-07-20T15:03:32.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:31 smithi178 bash[104918]: audit 2023-07-20T15:03:30.828904+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"c4023cd1-27fa-43bb-af46-790b726ab8f7\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1689865402.936293, \"finished_at\": 1689865410.8149052}], \"version\": 2, \"compat_version\": 2}"}]': finished 2023-07-20T15:03:32.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:31 smithi029 bash[104935]: cluster 2023-07-20T15:03:30.809930+0000 mon.a (mon.0) 677 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2023-07-20T15:03:32.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:31 smithi029 bash[104935]: cluster 2023-07-20T15:03:30.810012+0000 mon.a (mon.0) 678 : cluster [INF] Cluster is now healthy 2023-07-20T15:03:32.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:31 smithi029 bash[104935]: audit 2023-07-20T15:03:30.826307+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"c4023cd1-27fa-43bb-af46-790b726ab8f7\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1689865402.936293, \"finished_at\": 1689865410.8149052}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2023-07-20T15:03:32.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:31 smithi029 bash[104935]: audit 2023-07-20T15:03:30.828904+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"c4023cd1-27fa-43bb-af46-790b726ab8f7\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1689865402.936293, \"finished_at\": 1689865410.8149052}], \"version\": 2, \"compat_version\": 2}"}]': finished 2023-07-20T15:03:32.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:31 smithi029 bash[108361]: cluster 2023-07-20T15:03:30.809930+0000 mon.a (mon.0) 677 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2023-07-20T15:03:32.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:31 smithi029 bash[108361]: cluster 2023-07-20T15:03:30.810012+0000 mon.a (mon.0) 678 : cluster [INF] Cluster is now healthy 2023-07-20T15:03:32.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:31 smithi029 bash[108361]: audit 2023-07-20T15:03:30.826307+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"c4023cd1-27fa-43bb-af46-790b726ab8f7\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1689865402.936293, \"finished_at\": 1689865410.8149052}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2023-07-20T15:03:32.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:31 smithi029 bash[108361]: audit 2023-07-20T15:03:30.828904+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"c4023cd1-27fa-43bb-af46-790b726ab8f7\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1689865402.936293, \"finished_at\": 1689865410.8149052}], \"version\": 2, \"compat_version\": 2}"}]': finished 2023-07-20T15:03:32.888 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled alertmanager update... 2023-07-20T15:03:33.063 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:32 smithi178 bash[104918]: cluster 2023-07-20T15:03:31.812406+0000 mgr.y (mgr.14142) 138 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:33.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:32 smithi029 bash[104935]: cluster 2023-07-20T15:03:31.812406+0000 mgr.y (mgr.14142) 138 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:33.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:32 smithi029 bash[108361]: cluster 2023-07-20T15:03:31.812406+0000 mgr.y (mgr.14142) 138 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:33.304 DEBUG:teuthology.orchestra.run.smithi029:alertmanager.a> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@alertmanager.a.service 2023-07-20T15:03:33.308 INFO:tasks.cephadm:Adding grafana.a on smithi178 2023-07-20T15:03:33.309 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph orch apply grafana '1;smithi178=a' 2023-07-20T15:03:33.349 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:-- Logs begin at Thu 2023-07-20 14:49:36 UTC. -- 2023-07-20T15:03:34.176 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:33 smithi178 bash[104918]: audit 2023-07-20T15:03:32.836098+0000 mgr.y (mgr.14142) 139 : audit [DBG] from='client.34361 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi029=a", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:03:34.176 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:33 smithi178 bash[104918]: cephadm 2023-07-20T15:03:32.836742+0000 mgr.y (mgr.14142) 140 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi029=a 2023-07-20T15:03:34.176 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:33 smithi178 bash[104918]: audit 2023-07-20T15:03:32.837148+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2023-07-20T15:03:32.836764\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2023-07-20T15:03:34.176 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:33 smithi178 bash[104918]: audit 2023-07-20T15:03:32.840581+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2023-07-20T15:03:32.836764\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2023-07-20T15:03:34.199 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:33 smithi029 bash[108361]: audit 2023-07-20T15:03:32.836098+0000 mgr.y (mgr.14142) 139 : audit [DBG] from='client.34361 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi029=a", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:03:34.199 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:33 smithi029 bash[108361]: cephadm 2023-07-20T15:03:32.836742+0000 mgr.y (mgr.14142) 140 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi029=a 2023-07-20T15:03:34.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:33 smithi029 bash[108361]: audit 2023-07-20T15:03:32.837148+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2023-07-20T15:03:32.836764\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2023-07-20T15:03:34.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:33 smithi029 bash[108361]: audit 2023-07-20T15:03:32.840581+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2023-07-20T15:03:32.836764\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2023-07-20T15:03:34.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:33 smithi029 bash[104935]: audit 2023-07-20T15:03:32.836098+0000 mgr.y (mgr.14142) 139 : audit [DBG] from='client.34361 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi029=a", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:03:34.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:33 smithi029 bash[104935]: cephadm 2023-07-20T15:03:32.836742+0000 mgr.y (mgr.14142) 140 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi029=a 2023-07-20T15:03:34.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:33 smithi029 bash[104935]: audit 2023-07-20T15:03:32.837148+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2023-07-20T15:03:32.836764\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2023-07-20T15:03:34.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:33 smithi029 bash[104935]: audit 2023-07-20T15:03:32.840581+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2023-07-20T15:03:32.836764\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi029\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2023-07-20T15:03:34.848 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled grafana update... 2023-07-20T15:03:34.868 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:34 smithi178 podman[115279]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-prometheus.a" found: no such container 2023-07-20T15:03:34.868 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:34 smithi178 systemd[1]: Started Ceph prometheus.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:03:35.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:34 smithi178 bash[104918]: cluster 2023-07-20T15:03:33.812839+0000 mgr.y (mgr.14142) 141 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:35.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:34 smithi178 bash[104918]: audit 2023-07-20T15:03:34.635324+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:35.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:34 smithi178 bash[104918]: audit 2023-07-20T15:03:34.638497+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:35.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:34 smithi178 bash[104918]: audit 2023-07-20T15:03:34.639405+0000 mon.a (mon.0) 685 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:35.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:34 smithi178 bash[104918]: audit 2023-07-20T15:03:34.796747+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2023-07-20T15:03:34.796416\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi178\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2023-07-20T15:03:35.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:34 smithi178 bash[104918]: audit 2023-07-20T15:03:34.799906+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2023-07-20T15:03:34.796416\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi178\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2023-07-20T15:03:35.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:34 smithi029 bash[104935]: cluster 2023-07-20T15:03:33.812839+0000 mgr.y (mgr.14142) 141 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:35.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:34 smithi029 bash[108361]: cluster 2023-07-20T15:03:33.812839+0000 mgr.y (mgr.14142) 141 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:35.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:34 smithi029 bash[108361]: audit 2023-07-20T15:03:34.635324+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:35.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:34 smithi029 bash[104935]: audit 2023-07-20T15:03:34.635324+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:35.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:34 smithi029 bash[108361]: audit 2023-07-20T15:03:34.638497+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:35.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:34 smithi029 bash[108361]: audit 2023-07-20T15:03:34.639405+0000 mon.a (mon.0) 685 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:35.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:34 smithi029 bash[108361]: audit 2023-07-20T15:03:34.796747+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2023-07-20T15:03:34.796416\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi178\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2023-07-20T15:03:35.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:34 smithi029 bash[108361]: audit 2023-07-20T15:03:34.799906+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2023-07-20T15:03:34.796416\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi178\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2023-07-20T15:03:35.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:34 smithi029 bash[104935]: audit 2023-07-20T15:03:34.638497+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847195\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847279\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847314\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847346\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847376\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:19.847406\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:35.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:34 smithi029 bash[104935]: audit 2023-07-20T15:03:34.639405+0000 mon.a (mon.0) 685 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:35.207 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:34 smithi029 bash[104935]: audit 2023-07-20T15:03:34.796747+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2023-07-20T15:03:34.796416\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi178\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2023-07-20T15:03:35.207 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:34 smithi029 bash[104935]: audit 2023-07-20T15:03:34.799906+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2023-07-20T15:03:34.796416\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi178\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2023-07-20T15:03:35.482 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.131Z caller=main.go:534 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2023-07-20T15:03:35.482 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.132Z caller=main.go:578 level=info msg="Starting Prometheus Server" mode=server version="(version=2.45.0, branch=HEAD, revision=8ef767e396bf8445f009f945b0162fd71827f445)" 2023-07-20T15:03:35.482 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.132Z caller=main.go:583 level=info build_context="(go=go1.20.5, platform=linux/amd64, user=root@920118f645b7, date=20230623-15:09:49, tags=netgo,builtinassets,stringlabels)" 2023-07-20T15:03:35.483 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.132Z caller=main.go:584 level=info host_details="(Linux 4.18.0-500.el8.x86_64 #1 SMP Wed Jun 28 00:07:07 UTC 2023 x86_64 smithi178 (none))" 2023-07-20T15:03:35.483 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.132Z caller=main.go:585 level=info fd_limits="(soft=1048576, hard=1048576)" 2023-07-20T15:03:35.483 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.132Z caller=main.go:586 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2023-07-20T15:03:35.484 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.133Z caller=web.go:562 level=info component=web msg="Start listening for connections" address=:9095 2023-07-20T15:03:35.485 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.134Z caller=main.go:1019 level=info msg="Starting TSDB ..." 2023-07-20T15:03:35.485 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.134Z caller=tls_config.go:274 level=info component=web msg="Listening on" address=[::]:9095 2023-07-20T15:03:35.486 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.135Z caller=tls_config.go:277 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2023-07-20T15:03:35.486 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.136Z caller=head.go:595 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2023-07-20T15:03:35.486 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.136Z caller=head.go:676 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.483µs 2023-07-20T15:03:35.486 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.136Z caller=head.go:684 level=info component=tsdb msg="Replaying WAL, this may take a while" 2023-07-20T15:03:35.487 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.138Z caller=head.go:755 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2023-07-20T15:03:35.487 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.138Z caller=head.go:792 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=40.391µs wal_replay_duration=1.502227ms wbl_replay_duration=130ns total_replay_duration=1.570839ms 2023-07-20T15:03:35.487 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.139Z caller=main.go:1040 level=info fs_type=XFS_SUPER_MAGIC 2023-07-20T15:03:35.487 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.139Z caller=main.go:1043 level=info msg="TSDB started" 2023-07-20T15:03:35.487 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.139Z caller=main.go:1224 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2023-07-20T15:03:35.488 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.139Z caller=main.go:1261 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=656.896µs db_storage=740ns remote_storage=1.098µs web_handler=299ns query_engine=564ns scrape=381.823µs scrape_sd=18.627µs notify=700ns notify_sd=1.307µs rules=27.153µs tracing=5.827µs 2023-07-20T15:03:35.488 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.139Z caller=main.go:1004 level=info msg="Server is ready to receive web requests." 2023-07-20T15:03:35.493 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[115318]: ts=2023-07-20T15:03:35.139Z caller=manager.go:995 level=info component="rule manager" msg="Starting rule manager..." 2023-07-20T15:03:35.495 DEBUG:teuthology.orchestra.run.smithi178:grafana.a> sudo journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@grafana.a.service 2023-07-20T15:03:35.501 INFO:tasks.cephadm:Setting up client nodes... 2023-07-20T15:03:35.501 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-07-20T15:03:35.545 INFO:journalctl@ceph.grafana.a.smithi178.stdout:-- Logs begin at Thu 2023-07-20 14:49:59 UTC. -- 2023-07-20T15:03:36.167 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:35 smithi029 bash[104935]: audit 2023-07-20T15:03:34.795858+0000 mgr.y (mgr.14142) 142 : audit [DBG] from='client.34367 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi178=a", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:03:36.169 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:35 smithi029 bash[104935]: cephadm 2023-07-20T15:03:34.796401+0000 mgr.y (mgr.14142) 143 : cephadm [INF] Saving service grafana spec with placement count:1 smithi178=a 2023-07-20T15:03:36.170 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:35 smithi029 bash[108361]: audit 2023-07-20T15:03:34.795858+0000 mgr.y (mgr.14142) 142 : audit [DBG] from='client.34367 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi178=a", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:03:36.170 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:35 smithi029 bash[108361]: cephadm 2023-07-20T15:03:34.796401+0000 mgr.y (mgr.14142) 143 : cephadm [INF] Saving service grafana spec with placement count:1 smithi178=a 2023-07-20T15:03:36.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[104918]: audit 2023-07-20T15:03:34.795858+0000 mgr.y (mgr.14142) 142 : audit [DBG] from='client.34367 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi178=a", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:03:36.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:35 smithi178 bash[104918]: cephadm 2023-07-20T15:03:34.796401+0000 mgr.y (mgr.14142) 143 : cephadm [INF] Saving service grafana spec with placement count:1 smithi178=a 2023-07-20T15:03:36.872 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:36 smithi029 podman[118557]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-node-exporter.a" found: no such container 2023-07-20T15:03:36.872 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:36 smithi029 systemd[1]: Started Ceph node-exporter.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:03:37.036 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2023-07-20T15:03:37.037 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDITLlkA7fOOhAALSHuZdUPJ6gRZ8C37pUjTw== 2023-07-20T15:03:37.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:36 smithi178 bash[104918]: cluster 2023-07-20T15:03:35.813146+0000 mgr.y (mgr.14142) 144 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:37.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:36 smithi178 bash[104918]: audit 2023-07-20T15:03:36.125340+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}}, \"last_daemon_update\": \"2023-07-20T15:03:36.124645\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:37.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:36 smithi178 bash[104918]: audit 2023-07-20T15:03:36.128833+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}}, \"last_daemon_update\": \"2023-07-20T15:03:36.124645\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:37.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:36 smithi178 bash[104918]: audit 2023-07-20T15:03:36.130111+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2023-07-20T15:03:37.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:36 smithi178 bash[104918]: audit 2023-07-20T15:03:36.130721+0000 mon.a (mon.0) 691 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:37.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:36 smithi178 bash[104918]: cephadm 2023-07-20T15:03:36.131207+0000 mgr.y (mgr.14142) 145 : cephadm [INF] Deploying daemon node-exporter.a on smithi029 2023-07-20T15:03:37.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:36 smithi178 bash[104918]: audit 2023-07-20T15:03:36.756120+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:03:37.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:36 smithi178 bash[104918]: audit 2023-07-20T15:03:36.759677+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:03:37.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:36 smithi178 bash[104918]: audit 2023-07-20T15:03:36.760341+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2023-07-20T15:03:37.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:36 smithi178 bash[104918]: audit 2023-07-20T15:03:36.760947+0000 mon.a (mon.0) 695 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:37.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:36 smithi178 bash[104918]: cephadm 2023-07-20T15:03:36.761516+0000 mgr.y (mgr.14142) 146 : cephadm [INF] Deploying daemon node-exporter.b on smithi178 2023-07-20T15:03:37.198 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[118580]: Resolving "prom/node-exporter" using unqualified-search registries (/etc/containers/registries.conf) 2023-07-20T15:03:37.198 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[118580]: Trying to pull docker.io/prom/node-exporter:latest... 2023-07-20T15:03:37.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[104935]: cluster 2023-07-20T15:03:35.813146+0000 mgr.y (mgr.14142) 144 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:37.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[104935]: audit 2023-07-20T15:03:36.125340+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}}, \"last_daemon_update\": \"2023-07-20T15:03:36.124645\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:37.199 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[108361]: cluster 2023-07-20T15:03:35.813146+0000 mgr.y (mgr.14142) 144 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:37.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[104935]: audit 2023-07-20T15:03:36.128833+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}}, \"last_daemon_update\": \"2023-07-20T15:03:36.124645\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:37.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[104935]: audit 2023-07-20T15:03:36.130111+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2023-07-20T15:03:37.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[104935]: audit 2023-07-20T15:03:36.130721+0000 mon.a (mon.0) 691 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:37.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[104935]: cephadm 2023-07-20T15:03:36.131207+0000 mgr.y (mgr.14142) 145 : cephadm [INF] Deploying daemon node-exporter.a on smithi029 2023-07-20T15:03:37.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[108361]: audit 2023-07-20T15:03:36.125340+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}}, \"last_daemon_update\": \"2023-07-20T15:03:36.124645\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:37.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[104935]: audit 2023-07-20T15:03:36.756120+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:03:37.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[108361]: audit 2023-07-20T15:03:36.128833+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}}, \"last_daemon_update\": \"2023-07-20T15:03:36.124645\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:37.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[108361]: audit 2023-07-20T15:03:36.130111+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2023-07-20T15:03:37.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[108361]: audit 2023-07-20T15:03:36.130721+0000 mon.a (mon.0) 691 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:37.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[108361]: cephadm 2023-07-20T15:03:36.131207+0000 mgr.y (mgr.14142) 145 : cephadm [INF] Deploying daemon node-exporter.a on smithi029 2023-07-20T15:03:37.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[104935]: audit 2023-07-20T15:03:36.759677+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:03:37.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[104935]: audit 2023-07-20T15:03:36.760341+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2023-07-20T15:03:37.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[104935]: audit 2023-07-20T15:03:36.760947+0000 mon.a (mon.0) 695 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:37.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[104935]: cephadm 2023-07-20T15:03:36.761516+0000 mgr.y (mgr.14142) 146 : cephadm [INF] Deploying daemon node-exporter.b on smithi178 2023-07-20T15:03:37.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[108361]: audit 2023-07-20T15:03:36.756120+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:03:37.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[108361]: audit 2023-07-20T15:03:36.759677+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:03:37.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[108361]: audit 2023-07-20T15:03:36.760341+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2023-07-20T15:03:37.209 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[108361]: audit 2023-07-20T15:03:36.760947+0000 mon.a (mon.0) 695 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:03:37.209 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:36 smithi029 bash[108361]: cephadm 2023-07-20T15:03:36.761516+0000 mgr.y (mgr.14142) 146 : cephadm [INF] Deploying daemon node-exporter.b on smithi178 2023-07-20T15:03:37.400 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-07-20T15:03:37.401 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-07-20T15:03:37.401 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-20T15:03:37.446 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-07-20T15:03:37.670 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:37 smithi178 systemd[1]: Started Ceph node-exporter.b for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:03:37.670 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:37 smithi178 bash[115776]: Resolving "prom/node-exporter" using unqualified-search registries (/etc/containers/registries.conf) 2023-07-20T15:03:37.670 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:37 smithi178 bash[115776]: Trying to pull docker.io/prom/node-exporter:latest... 2023-07-20T15:03:37.713 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:37 smithi029 bash[118580]: Getting image source signatures 2023-07-20T15:03:37.713 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:37 smithi029 bash[118580]: Copying blob sha256:2b6642e6c59e6b5d78b3df938a369500dc114b4062860cd68b7b621bd9ee0776 2023-07-20T15:03:37.713 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:37 smithi029 bash[118580]: Copying blob sha256:d5c4df21b1271e0e591ad24fe3e37a5cfdaecb09345ed7046f293d3682f9932d 2023-07-20T15:03:37.714 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:37 smithi029 bash[118580]: Copying blob sha256:2f5f7d8898a19f16514c28bb0cde62e6bcf22e74fc07a63dc6a8046d4c77beb3 2023-07-20T15:03:37.959 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:37 smithi178 bash[115776]: Getting image source signatures 2023-07-20T15:03:37.963 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:37 smithi178 bash[115776]: Copying blob sha256:2b6642e6c59e6b5d78b3df938a369500dc114b4062860cd68b7b621bd9ee0776 2023-07-20T15:03:37.964 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:37 smithi178 bash[115776]: Copying blob sha256:d5c4df21b1271e0e591ad24fe3e37a5cfdaecb09345ed7046f293d3682f9932d 2023-07-20T15:03:37.965 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:37 smithi178 bash[115776]: Copying blob sha256:2f5f7d8898a19f16514c28bb0cde62e6bcf22e74fc07a63dc6a8046d4c77beb3 2023-07-20T15:03:37.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:37 smithi178 bash[104918]: audit 2023-07-20T15:03:36.986503+0000 mon.a (mon.0) 696 : audit [INF] from='client.? 172.21.15.29:0/3531628581' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-20T15:03:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:37 smithi178 bash[104918]: audit 2023-07-20T15:03:36.990506+0000 mon.a (mon.0) 697 : audit [INF] from='client.? 172.21.15.29:0/3531628581' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-07-20T15:03:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:37 smithi178 bash[104918]: audit 2023-07-20T15:03:37.262471+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:37 smithi178 bash[104918]: audit 2023-07-20T15:03:37.265245+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:37 smithi178 bash[104918]: cephadm 2023-07-20T15:03:37.267447+0000 mgr.y (mgr.14142) 147 : cephadm [INF] Deploying daemon alertmanager.a on smithi029 2023-07-20T15:03:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:37 smithi178 bash[104918]: cluster 2023-07-20T15:03:37.813522+0000 mgr.y (mgr.14142) 148 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:38.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:37 smithi029 bash[108361]: audit 2023-07-20T15:03:36.986503+0000 mon.a (mon.0) 696 : audit [INF] from='client.? 172.21.15.29:0/3531628581' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-20T15:03:38.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:37 smithi029 bash[108361]: audit 2023-07-20T15:03:36.990506+0000 mon.a (mon.0) 697 : audit [INF] from='client.? 172.21.15.29:0/3531628581' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-07-20T15:03:38.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:37 smithi029 bash[104935]: audit 2023-07-20T15:03:36.986503+0000 mon.a (mon.0) 696 : audit [INF] from='client.? 172.21.15.29:0/3531628581' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-20T15:03:38.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:37 smithi029 bash[104935]: audit 2023-07-20T15:03:36.990506+0000 mon.a (mon.0) 697 : audit [INF] from='client.? 172.21.15.29:0/3531628581' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-07-20T15:03:38.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:37 smithi029 bash[108361]: audit 2023-07-20T15:03:37.262471+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:38.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:37 smithi029 bash[108361]: audit 2023-07-20T15:03:37.265245+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:38.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:37 smithi029 bash[108361]: cephadm 2023-07-20T15:03:37.267447+0000 mgr.y (mgr.14142) 147 : cephadm [INF] Deploying daemon alertmanager.a on smithi029 2023-07-20T15:03:38.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:37 smithi029 bash[108361]: cluster 2023-07-20T15:03:37.813522+0000 mgr.y (mgr.14142) 148 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:38.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:37 smithi029 bash[104935]: audit 2023-07-20T15:03:37.262471+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:38.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:37 smithi029 bash[104935]: audit 2023-07-20T15:03:37.265245+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:38.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:37 smithi029 bash[104935]: cephadm 2023-07-20T15:03:37.267447+0000 mgr.y (mgr.14142) 147 : cephadm [INF] Deploying daemon alertmanager.a on smithi029 2023-07-20T15:03:38.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:37 smithi029 bash[104935]: cluster 2023-07-20T15:03:37.813522+0000 mgr.y (mgr.14142) 148 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:38.698 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:38 smithi029 bash[118580]: Copying config sha256:458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c 2023-07-20T15:03:38.699 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:38 smithi029 bash[118580]: Writing manifest to image destination 2023-07-20T15:03:38.699 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:38 smithi029 bash[118580]: Storing signatures 2023-07-20T15:03:38.918 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:38 smithi178 bash[115776]: Copying config sha256:458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c 2023-07-20T15:03:39.420 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: Writing manifest to image destination 2023-07-20T15:03:39.421 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: Storing signatures 2023-07-20T15:03:39.491 INFO:teuthology.orchestra.run.smithi178.stdout:[client.1] 2023-07-20T15:03:39.492 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQDLTLlkErt7GhAAvVQl+Mlx0/OpVTbgbxhafQ== 2023-07-20T15:03:39.780 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[104918]: audit 2023-07-20T15:03:39.443733+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.178:0/3512158887' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-20T15:03:39.780 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[104918]: audit 2023-07-20T15:03:39.444186+0000 mon.a (mon.0) 700 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-20T15:03:39.781 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[104918]: audit 2023-07-20T15:03:39.447900+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-07-20T15:03:39.948 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:39 smithi029 bash[104935]: audit 2023-07-20T15:03:39.443733+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.178:0/3512158887' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-20T15:03:39.948 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:39 smithi029 bash[104935]: audit 2023-07-20T15:03:39.444186+0000 mon.a (mon.0) 700 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-20T15:03:39.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:39 smithi029 bash[104935]: audit 2023-07-20T15:03:39.447900+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-07-20T15:03:39.949 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:39 smithi029 bash[108361]: audit 2023-07-20T15:03:39.443733+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.178:0/3512158887' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-20T15:03:39.949 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:39 smithi029 bash[108361]: audit 2023-07-20T15:03:39.444186+0000 mon.a (mon.0) 700 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-20T15:03:39.949 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:39 smithi029 bash[108361]: audit 2023-07-20T15:03:39.447900+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-07-20T15:03:39.993 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-07-20T15:03:39.994 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2023-07-20T15:03:39.994 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-20T15:03:40.034 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.709Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.6.1, branch=HEAD, revision=4a1b77600c1873a8233f3ffb55afcedbb63b8d84)" 2023-07-20T15:03:40.034 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.709Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.20.6, platform=linux/amd64, user=root@586879db11e5, date=20230717-12:10:52, tags=netgo osusergo static_build)" 2023-07-20T15:03:40.035 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2023-07-20T15:03:40.035 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2023-07-20T15:03:40.035 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2023-07-20T15:03:40.035 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2023-07-20T15:03:40.035 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2023-07-20T15:03:40.035 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=arp 2023-07-20T15:03:40.035 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=bcache 2023-07-20T15:03:40.035 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=bonding 2023-07-20T15:03:40.036 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=btrfs 2023-07-20T15:03:40.036 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=conntrack 2023-07-20T15:03:40.036 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=cpu 2023-07-20T15:03:40.036 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=cpufreq 2023-07-20T15:03:40.036 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=diskstats 2023-07-20T15:03:40.036 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=dmi 2023-07-20T15:03:40.036 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=edac 2023-07-20T15:03:40.037 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=entropy 2023-07-20T15:03:40.037 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=fibrechannel 2023-07-20T15:03:40.037 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=filefd 2023-07-20T15:03:40.037 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=filesystem 2023-07-20T15:03:40.037 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=hwmon 2023-07-20T15:03:40.037 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=infiniband 2023-07-20T15:03:40.037 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=ipvs 2023-07-20T15:03:40.037 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=loadavg 2023-07-20T15:03:40.038 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=mdadm 2023-07-20T15:03:40.038 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=meminfo 2023-07-20T15:03:40.038 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=netclass 2023-07-20T15:03:40.038 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=netdev 2023-07-20T15:03:40.038 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=netstat 2023-07-20T15:03:40.038 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=nfs 2023-07-20T15:03:40.038 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=nfsd 2023-07-20T15:03:40.039 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=nvme 2023-07-20T15:03:40.039 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=os 2023-07-20T15:03:40.039 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2023-07-20T15:03:40.039 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=pressure 2023-07-20T15:03:40.039 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=rapl 2023-07-20T15:03:40.042 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=schedstat 2023-07-20T15:03:40.043 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=selinux 2023-07-20T15:03:40.043 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=sockstat 2023-07-20T15:03:40.043 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=softnet 2023-07-20T15:03:40.043 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=stat 2023-07-20T15:03:40.043 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=tapestats 2023-07-20T15:03:40.044 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=textfile 2023-07-20T15:03:40.044 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=thermal_zone 2023-07-20T15:03:40.044 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=time 2023-07-20T15:03:40.044 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=udp_queues 2023-07-20T15:03:40.044 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=uname 2023-07-20T15:03:40.044 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=vmstat 2023-07-20T15:03:40.044 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=xfs 2023-07-20T15:03:40.045 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.710Z caller=node_exporter.go:117 level=info collector=zfs 2023-07-20T15:03:40.045 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.711Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2023-07-20T15:03:40.045 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:03:39 smithi178 bash[115776]: ts=2023-07-20T15:03:39.711Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2023-07-20T15:03:40.046 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph osd dump --format=json 2023-07-20T15:03:41.045 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[104935]: cluster 2023-07-20T15:03:39.813820+0000 mgr.y (mgr.14142) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:41.046 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[108361]: cluster 2023-07-20T15:03:39.813820+0000 mgr.y (mgr.14142) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:41.055 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.807Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.6.1, branch=HEAD, revision=4a1b77600c1873a8233f3ffb55afcedbb63b8d84)" 2023-07-20T15:03:41.055 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.807Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.20.6, platform=linux/amd64, user=root@586879db11e5, date=20230717-12:10:52, tags=netgo osusergo static_build)" 2023-07-20T15:03:41.055 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.808Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2023-07-20T15:03:41.056 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.808Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2023-07-20T15:03:41.056 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.808Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2023-07-20T15:03:41.056 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.808Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2023-07-20T15:03:41.056 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2023-07-20T15:03:41.057 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=arp 2023-07-20T15:03:41.057 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=bcache 2023-07-20T15:03:41.057 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=bonding 2023-07-20T15:03:41.057 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=btrfs 2023-07-20T15:03:41.057 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=conntrack 2023-07-20T15:03:41.058 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=cpu 2023-07-20T15:03:41.058 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=cpufreq 2023-07-20T15:03:41.058 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=diskstats 2023-07-20T15:03:41.058 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=dmi 2023-07-20T15:03:41.059 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=edac 2023-07-20T15:03:41.059 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=entropy 2023-07-20T15:03:41.059 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=fibrechannel 2023-07-20T15:03:41.059 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=filefd 2023-07-20T15:03:41.059 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=filesystem 2023-07-20T15:03:41.060 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=hwmon 2023-07-20T15:03:41.060 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=infiniband 2023-07-20T15:03:41.060 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=ipvs 2023-07-20T15:03:41.061 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=loadavg 2023-07-20T15:03:41.061 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=mdadm 2023-07-20T15:03:41.061 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=meminfo 2023-07-20T15:03:41.061 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=netclass 2023-07-20T15:03:41.061 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=netdev 2023-07-20T15:03:41.062 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=netstat 2023-07-20T15:03:41.062 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=nfs 2023-07-20T15:03:41.062 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=nfsd 2023-07-20T15:03:41.062 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=nvme 2023-07-20T15:03:41.062 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=os 2023-07-20T15:03:41.062 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2023-07-20T15:03:41.062 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=pressure 2023-07-20T15:03:41.063 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=rapl 2023-07-20T15:03:41.063 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=schedstat 2023-07-20T15:03:41.063 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=selinux 2023-07-20T15:03:41.063 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=sockstat 2023-07-20T15:03:41.063 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=softnet 2023-07-20T15:03:41.063 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=stat 2023-07-20T15:03:41.063 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=tapestats 2023-07-20T15:03:41.063 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=textfile 2023-07-20T15:03:41.064 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=thermal_zone 2023-07-20T15:03:41.064 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=time 2023-07-20T15:03:41.064 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=udp_queues 2023-07-20T15:03:41.065 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=uname 2023-07-20T15:03:41.065 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=vmstat 2023-07-20T15:03:41.065 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=xfs 2023-07-20T15:03:41.065 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=node_exporter.go:117 level=info collector=zfs 2023-07-20T15:03:41.065 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2023-07-20T15:03:41.065 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:03:40 smithi029 bash[118580]: ts=2023-07-20T15:03:40.809Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2023-07-20T15:03:41.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:40 smithi178 bash[104918]: cluster 2023-07-20T15:03:39.813820+0000 mgr.y (mgr.14142) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:42.283 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T15:03:42.284 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":61,"fsid":"021c9860-270e-11ee-9b34-001a4aab830c","created":"2023-07-20T14:59:41.581865+0000","modified":"2023-07-20T15:03:23.938648+0000","last_up_change":"2023-07-20T15:03:22.932676+0000","last_in_change":"2023-07-20T15:03:22.932676+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-20T14:59:50.222865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"f8465b78-5108-4a6c-8741-1aacec147eb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":12,"up_from":14,"up_thru":59,"down_at":13,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1634899187},{"type":"v1","addr":"172.21.15.29:6803","nonce":1634899187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1634899187},{"type":"v1","addr":"172.21.15.29:6805","nonce":1634899187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1634899187},{"type":"v1","addr":"172.21.15.29:6809","nonce":1634899187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1634899187},{"type":"v1","addr":"172.21.15.29:6807","nonce":1634899187}]},"public_addr":"172.21.15.29:6803/1634899187","cluster_addr":"172.21.15.29:6805/1634899187","heartbeat_back_addr":"172.21.15.29:6809/1634899187","heartbeat_front_addr":"172.21.15.29:6807/1634899187","state":["exists","up"]},{"osd":1,"uuid":"0f51402c-d77b-420c-801b-5b204f09a8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":17,"last_clean_end":18,"up_from":20,"up_thru":40,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1986287135},{"type":"v1","addr":"172.21.15.29:6811","nonce":1986287135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1986287135},{"type":"v1","addr":"172.21.15.29:6813","nonce":1986287135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":1986287135},{"type":"v1","addr":"172.21.15.29:6817","nonce":1986287135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1986287135},{"type":"v1","addr":"172.21.15.29:6815","nonce":1986287135}]},"public_addr":"172.21.15.29:6811/1986287135","cluster_addr":"172.21.15.29:6813/1986287135","heartbeat_back_addr":"172.21.15.29:6817/1986287135","heartbeat_front_addr":"172.21.15.29:6815/1986287135","state":["exists","up"]},{"osd":2,"uuid":"2a028cba-0ec6-4032-96ef-177180fe78cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":23,"last_clean_end":24,"up_from":27,"up_thru":0,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":775038871},{"type":"v1","addr":"172.21.15.29:6819","nonce":775038871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":775038871},{"type":"v1","addr":"172.21.15.29:6821","nonce":775038871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":775038871},{"type":"v1","addr":"172.21.15.29:6825","nonce":775038871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":775038871},{"type":"v1","addr":"172.21.15.29:6823","nonce":775038871}]},"public_addr":"172.21.15.29:6819/775038871","cluster_addr":"172.21.15.29:6821/775038871","heartbeat_back_addr":"172.21.15.29:6825/775038871","heartbeat_front_addr":"172.21.15.29:6823/775038871","state":["exists","up"]},{"osd":3,"uuid":"4d7d62a7-fee8-4b91-aaef-43c33da61525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":3537910860},{"type":"v1","addr":"172.21.15.29:6827","nonce":3537910860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":3537910860},{"type":"v1","addr":"172.21.15.29:6829","nonce":3537910860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3537910860},{"type":"v1","addr":"172.21.15.29:6833","nonce":3537910860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":3537910860},{"type":"v1","addr":"172.21.15.29:6831","nonce":3537910860}]},"public_addr":"172.21.15.29:6827/3537910860","cluster_addr":"172.21.15.29:6829/3537910860","heartbeat_back_addr":"172.21.15.29:6833/3537910860","heartbeat_front_addr":"172.21.15.29:6831/3537910860","state":["exists","up"]},{"osd":4,"uuid":"e424090f-0486-4402-887d-f4fc310d93d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":37,"up_from":40,"up_thru":0,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":915448555},{"type":"v1","addr":"172.21.15.178:6801","nonce":915448555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":915448555},{"type":"v1","addr":"172.21.15.178:6803","nonce":915448555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":915448555},{"type":"v1","addr":"172.21.15.178:6807","nonce":915448555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":915448555},{"type":"v1","addr":"172.21.15.178:6805","nonce":915448555}]},"public_addr":"172.21.15.178:6801/915448555","cluster_addr":"172.21.15.178:6803/915448555","heartbeat_back_addr":"172.21.15.178:6807/915448555","heartbeat_front_addr":"172.21.15.178:6805/915448555","state":["exists","up"]},{"osd":5,"uuid":"7ff93523-43ae-478c-a87c-1044653beb64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":44,"last_clean_end":45,"up_from":48,"up_thru":48,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3613532761},{"type":"v1","addr":"172.21.15.178:6809","nonce":3613532761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3613532761},{"type":"v1","addr":"172.21.15.178:6811","nonce":3613532761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3613532761},{"type":"v1","addr":"172.21.15.178:6815","nonce":3613532761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3613532761},{"type":"v1","addr":"172.21.15.178:6813","nonce":3613532761}]},"public_addr":"172.21.15.178:6809/3613532761","cluster_addr":"172.21.15.178:6811/3613532761","heartbeat_back_addr":"172.21.15.178:6815/3613532761","heartbeat_front_addr":"172.21.15.178:6813/3613532761","state":["exists","up"]},{"osd":6,"uuid":"7a34c575-fbe7-465c-9f28-cdd42b784e43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":52,"last_clean_end":54,"up_from":57,"up_thru":57,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3503656327},{"type":"v1","addr":"172.21.15.178:6817","nonce":3503656327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3503656327},{"type":"v1","addr":"172.21.15.178:6819","nonce":3503656327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3503656327},{"type":"v1","addr":"172.21.15.178:6823","nonce":3503656327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3503656327},{"type":"v1","addr":"172.21.15.178:6821","nonce":3503656327}]},"public_addr":"172.21.15.178:6817/3503656327","cluster_addr":"172.21.15.178:6819/3503656327","heartbeat_back_addr":"172.21.15.178:6823/3503656327","heartbeat_front_addr":"172.21.15.178:6821/3503656327","state":["exists","up"]},{"osd":7,"uuid":"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3700445879},{"type":"v1","addr":"172.21.15.178:6825","nonce":3700445879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3700445879},{"type":"v1","addr":"172.21.15.178:6827","nonce":3700445879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3700445879},{"type":"v1","addr":"172.21.15.178:6831","nonce":3700445879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3700445879},{"type":"v1","addr":"172.21.15.178:6829","nonce":3700445879}]},"public_addr":"172.21.15.178:6825/3700445879","cluster_addr":"172.21.15.178:6827/3700445879","heartbeat_back_addr":"172.21.15.178:6831/3700445879","heartbeat_front_addr":"172.21.15.178:6829/3700445879","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2023-07-20T15:01:54.129144+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:01:41.900784+0000","dead_epoch":0},{"osd":1,"down_stamp":"2023-07-20T15:02:08.839614+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:01:56.629575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:02:11.666801+0000","dead_epoch":25},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:02:26.130345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:02:36.472369+0000","dead_epoch":38},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:02:52.041872+0000","dead_epoch":46},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:03:06.765870+0000","dead_epoch":55},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:03:21.664196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.29:6800/3325065975":"2023-07-21T15:00:15.623050+0000","172.21.15.29:6801/3325065975":"2023-07-21T15:00:15.623050+0000","172.21.15.29:0/4240559759":"2023-07-21T15:00:15.623050+0000","172.21.15.29:0/2115661188":"2023-07-21T15:00:15.623050+0000","172.21.15.29:0/3952452472":"2023-07-21T15:00:15.623050+0000","172.21.15.29:0/3782113586":"2023-07-21T14:59:58.056221+0000","172.21.15.29:6801/2412527169":"2023-07-21T14:59:58.056221+0000","172.21.15.29:0/784956587":"2023-07-21T14:59:58.056221+0000","172.21.15.29:6800/2412527169":"2023-07-21T14:59:58.056221+0000","172.21.15.29:0/3979765469":"2023-07-21T14:59:58.056221+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-07-20T15:03:42.813 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-20T14:59:50.222865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2023-07-20T15:03:42.814 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2023-07-20T15:03:43.071 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:42 smithi029 bash[104935]: cluster 2023-07-20T15:03:41.814288+0000 mgr.y (mgr.14142) 150 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:43.071 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:42 smithi029 bash[104935]: audit 2023-07-20T15:03:42.237044+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.29:0/673145345' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-20T15:03:43.071 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:42 smithi029 bash[108361]: cluster 2023-07-20T15:03:41.814288+0000 mgr.y (mgr.14142) 150 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:43.071 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:42 smithi029 bash[108361]: audit 2023-07-20T15:03:42.237044+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.29:0/673145345' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-20T15:03:43.168 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:42 smithi178 bash[104918]: cluster 2023-07-20T15:03:41.814288+0000 mgr.y (mgr.14142) 150 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:43.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:42 smithi178 bash[104918]: audit 2023-07-20T15:03:42.237044+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.29:0/673145345' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-20T15:03:43.379 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:43 smithi029 podman[119208]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-alertmanager.a" found: no such container 2023-07-20T15:03:43.379 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:43 smithi029 systemd[1]: Started Ceph alertmanager.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:03:43.975 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[119224]: ts=2023-07-20T15:03:43.735Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2023-07-20T15:03:43.976 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[119224]: ts=2023-07-20T15:03:43.735Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2023-07-20T15:03:43.976 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[119224]: ts=2023-07-20T15:03:43.736Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.29 port=9094 2023-07-20T15:03:43.976 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[119224]: ts=2023-07-20T15:03:43.736Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2023-07-20T15:03:43.976 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[119224]: ts=2023-07-20T15:03:43.759Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2023-07-20T15:03:43.976 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[119224]: ts=2023-07-20T15:03:43.760Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2023-07-20T15:03:43.977 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[119224]: ts=2023-07-20T15:03:43.762Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2023-07-20T15:03:43.977 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[119224]: ts=2023-07-20T15:03:43.762Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2023-07-20T15:03:43.977 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[104935]: audit 2023-07-20T15:03:43.259837+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:37.265798\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:03:43.978 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[104935]: audit 2023-07-20T15:03:43.262882+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:37.265798\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:03:43.978 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[104935]: audit 2023-07-20T15:03:43.349589+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDkAw6JakBEEbus1ZIuGEfFMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjMwNzIwMTUwMzQzWhcN\nMzMwNzE3MTUwMzQzWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAzE4C7zsRmhPGZac31XMs\n4WtTMaSKtZqqPrrrxQN25C+2pxnQ1WzASQwJTP4oFF2KTFB+cfWC8exI5h6iwC8d\nLflHOf6D/E6+z3qBKTq1s6yGHKU1kYOd2YEbjvESO/QbeMRg8//tNDqwEuBriA0U\nr7KOumjyQ4ixll3h/S4w3nGPocaH0tQGZVt8jaAn9RjOsNOBO84pJjJ1lpZdKRB7\nIKaB9OipurH7cBoxw5O/PffQnkxFMZjRn1rytYyK5LGjcyaO9HYGr50pYlfRzmeQ\nkEBB9M64yyzDQo95toRG+FOm3b3Kcy5ZvdgPJGKkUwfhEKI79IpUXL3zQNmamquB\n2QIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQARi5W/9RRqjRwM1iAV0VlCYzshKMeF\n85r8bfgyWQx65/rdekaO0D83Z2v5tAs3px+bSN170U1H9Wz/Abe9a+6PI3wGOt8w\nEPIBFkMfDOGr1cstiLfFx+TUlwzI16XraImOpVRoUk5nClpJhC2gWGDT1yQItrJu\nklqJuzZFkRV7kw99Vew5YwCeT9W7iWzGbAS0EgXtXwrH9Ihm1fHP7taeuLEVembU\nQEk8KL/3a8qFcZixE2bIN5iX66OLhJ/JJboN72+IjFbc8YgMo7K9GgqxGdn34Dkh\nP6yQZFPhDUL9to9wHFCiUDItxS6PjP+7BHrbxIwPstrwaxn7C3ecAZqL\n-----END CERTIFICATE-----\n"}]: dispatch 2023-07-20T15:03:43.978 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[104935]: audit 2023-07-20T15:03:43.352625+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDkAw6JakBEEbus1ZIuGEfFMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjMwNzIwMTUwMzQzWhcN\nMzMwNzE3MTUwMzQzWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAzE4C7zsRmhPGZac31XMs\n4WtTMaSKtZqqPrrrxQN25C+2pxnQ1WzASQwJTP4oFF2KTFB+cfWC8exI5h6iwC8d\nLflHOf6D/E6+z3qBKTq1s6yGHKU1kYOd2YEbjvESO/QbeMRg8//tNDqwEuBriA0U\nr7KOumjyQ4ixll3h/S4w3nGPocaH0tQGZVt8jaAn9RjOsNOBO84pJjJ1lpZdKRB7\nIKaB9OipurH7cBoxw5O/PffQnkxFMZjRn1rytYyK5LGjcyaO9HYGr50pYlfRzmeQ\nkEBB9M64yyzDQo95toRG+FOm3b3Kcy5ZvdgPJGKkUwfhEKI79IpUXL3zQNmamquB\n2QIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQARi5W/9RRqjRwM1iAV0VlCYzshKMeF\n85r8bfgyWQx65/rdekaO0D83Z2v5tAs3px+bSN170U1H9Wz/Abe9a+6PI3wGOt8w\nEPIBFkMfDOGr1cstiLfFx+TUlwzI16XraImOpVRoUk5nClpJhC2gWGDT1yQItrJu\nklqJuzZFkRV7kw99Vew5YwCeT9W7iWzGbAS0EgXtXwrH9Ihm1fHP7taeuLEVembU\nQEk8KL/3a8qFcZixE2bIN5iX66OLhJ/JJboN72+IjFbc8YgMo7K9GgqxGdn34Dkh\nP6yQZFPhDUL9to9wHFCiUDItxS6PjP+7BHrbxIwPstrwaxn7C3ecAZqL\n-----END CERTIFICATE-----\n"}]': finished 2023-07-20T15:03:43.984 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[104935]: audit 2023-07-20T15:03:43.353068+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDMTgLvOxGaE8Zl\npzfVcyzha1MxpIq1mqo+uuvFA3bkL7anGdDVbMBJDAlM/igUXYpMUH5x9YLx7Ejm\nHqLALx0t+Uc5/oP8Tr7PeoEpOrWzrIYcpTWRg53ZgRuO8RI79Bt4xGDz/+00OrAS\n4GuIDRSvso66aPJDiLGWXeH9LjDecY+hxofS1AZlW3yNoCf1GM6w04E7zikmMnWW\nll0pEHsgpoH06Km6sftwGjHDk78999CeTEUxmNGfWvK1jIrksaNzJo70dgavnSli\nV9HOZ5CQQEH0zrjLLMNCj3m2hEb4U6bdvcpzLlm92A8kYqRTB+EQojv0ilRcvfNA\n2Zqaq4HZAgMBAAECggEBAKXca2t2Y+rXRQj/wUdLctMqg2bY8zdN8gptS70s+9dy\nmPF99tldqZlj6SUVbMpjykP8UTsJGx52OhSAKJanaSQKrPV7GAG8mBHunW8wV5Uf\nad1VjnCtDngm5Y2dTrVXjvnzS9arHhJ51rnsccAJBpNA/bh+PLfxAGNXooEdf9UF\nnz/JCYqsHsWNHLTpCFCGaiL0qkaT7FPnTXjVeJOmqNAQ6KmQXDArsmkrks/zSqV8\nvRkN/2GZma3nEJIk3mB+mawNZJ+56UeFFASamuGyf8zcX5kHwToPe3omQUAoMOkV\nwKnIz2VNOxKnaXsdtW/BTfnbH/PIbW+Y5nPoUY47JEUCgYEA50tKAqsYrP5TEhQI\nhAFh1TF8KIn44F2AxfYCIkoZ4wDuSHtpdPUVYMH9yhuZWY736wTnryU1PClsZ4M0\n9i4w7mdu3zrAgRaAsAmulis+vwMBgBo2BBRaSqAYHstQWlAInTgmmeGXzLO/zLlm\nnmGtU4CJovTY5eTjNbOBL5Bh6q8CgYEA4iCzgpUYhzIii94BpKqPkcSEqSmNyh64\n2ULdO+tWZm+hs+wTLEggV6kI6c1QweEZx8S2CgsEjcdqx/1sGYtcvWe4KhGfpzlg\n276gAb9vbRMbcpryf5Ny5q1cZhWenHnWxZ0E1ciHSqeW/a6WEqXe9ZLwcio9c8LD\nqLgLX3c33fcCgYA2NlZtk67f9WiBJ0Lrtes5bjTcx6IW7LOfMs9DPD0fEPvI72xD\nZqKRIEcdFST3ceQ4KNkpGz6EEG2BQaarQR5k8sdw+TNfzmdxW4OZXR+C4/B5Fyur\n/x0+upGMvjjiQjoSp7Ocg9zxtPvyv04HN3vJw6n/EQa5s9Fxp9ZS0LOyrwKBgGW5\nZEe4HsKi8RuOkZqsB84BY9RdlyV30JwcEj4kTkfirBGuf6mKANKufg3/iPbO9rQB\ncArwjenh7c1t2bVcFio2gIicSQAHNeVkycI/hjbBQ7W4sqJliGjxUAG0dBfcT5uy\nWTx66zHQVoJkiap15+j9YyFYkzCCS1aZBLS7guxdAoGAFzOrtxgtWSvMg/IVObSw\nbiMXtOE+ZXuwpnGULbBu5hVriIKi2I/3LzXgud5mgGw0scwPnknfyDqfHSv1FrAf\ndHjUUe0pJb5dRZpxSnhhKmzuB8XRsmvZgqYP94DSy7KhDCEMJzCvuh84ibAIORmc\nAgFwamkk9jFkC8CmSYZAx7o=\n-----END PRIVATE KEY-----\n"}]: dispatch 2023-07-20T15:03:43.984 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[104935]: audit 2023-07-20T15:03:43.355301+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDMTgLvOxGaE8Zl\npzfVcyzha1MxpIq1mqo+uuvFA3bkL7anGdDVbMBJDAlM/igUXYpMUH5x9YLx7Ejm\nHqLALx0t+Uc5/oP8Tr7PeoEpOrWzrIYcpTWRg53ZgRuO8RI79Bt4xGDz/+00OrAS\n4GuIDRSvso66aPJDiLGWXeH9LjDecY+hxofS1AZlW3yNoCf1GM6w04E7zikmMnWW\nll0pEHsgpoH06Km6sftwGjHDk78999CeTEUxmNGfWvK1jIrksaNzJo70dgavnSli\nV9HOZ5CQQEH0zrjLLMNCj3m2hEb4U6bdvcpzLlm92A8kYqRTB+EQojv0ilRcvfNA\n2Zqaq4HZAgMBAAECggEBAKXca2t2Y+rXRQj/wUdLctMqg2bY8zdN8gptS70s+9dy\nmPF99tldqZlj6SUVbMpjykP8UTsJGx52OhSAKJanaSQKrPV7GAG8mBHunW8wV5Uf\nad1VjnCtDngm5Y2dTrVXjvnzS9arHhJ51rnsccAJBpNA/bh+PLfxAGNXooEdf9UF\nnz/JCYqsHsWNHLTpCFCGaiL0qkaT7FPnTXjVeJOmqNAQ6KmQXDArsmkrks/zSqV8\nvRkN/2GZma3nEJIk3mB+mawNZJ+56UeFFASamuGyf8zcX5kHwToPe3omQUAoMOkV\nwKnIz2VNOxKnaXsdtW/BTfnbH/PIbW+Y5nPoUY47JEUCgYEA50tKAqsYrP5TEhQI\nhAFh1TF8KIn44F2AxfYCIkoZ4wDuSHtpdPUVYMH9yhuZWY736wTnryU1PClsZ4M0\n9i4w7mdu3zrAgRaAsAmulis+vwMBgBo2BBRaSqAYHstQWlAInTgmmeGXzLO/zLlm\nnmGtU4CJovTY5eTjNbOBL5Bh6q8CgYEA4iCzgpUYhzIii94BpKqPkcSEqSmNyh64\n2ULdO+tWZm+hs+wTLEggV6kI6c1QweEZx8S2CgsEjcdqx/1sGYtcvWe4KhGfpzlg\n276gAb9vbRMbcpryf5Ny5q1cZhWenHnWxZ0E1ciHSqeW/a6WEqXe9ZLwcio9c8LD\nqLgLX3c33fcCgYA2NlZtk67f9WiBJ0Lrtes5bjTcx6IW7LOfMs9DPD0fEPvI72xD\nZqKRIEcdFST3ceQ4KNkpGz6EEG2BQaarQR5k8sdw+TNfzmdxW4OZXR+C4/B5Fyur\n/x0+upGMvjjiQjoSp7Ocg9zxtPvyv04HN3vJw6n/EQa5s9Fxp9ZS0LOyrwKBgGW5\nZEe4HsKi8RuOkZqsB84BY9RdlyV30JwcEj4kTkfirBGuf6mKANKufg3/iPbO9rQB\ncArwjenh7c1t2bVcFio2gIicSQAHNeVkycI/hjbBQ7W4sqJliGjxUAG0dBfcT5uy\nWTx66zHQVoJkiap15+j9YyFYkzCCS1aZBLS7guxdAoGAFzOrtxgtWSvMg/IVObSw\nbiMXtOE+ZXuwpnGULbBu5hVriIKi2I/3LzXgud5mgGw0scwPnknfyDqfHSv1FrAf\ndHjUUe0pJb5dRZpxSnhhKmzuB8XRsmvZgqYP94DSy7KhDCEMJzCvuh84ibAIORmc\nAgFwamkk9jFkC8CmSYZAx7o=\n-----END PRIVATE KEY-----\n"}]': finished 2023-07-20T15:03:43.985 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[108361]: audit 2023-07-20T15:03:43.259837+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:37.265798\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:03:43.986 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[108361]: audit 2023-07-20T15:03:43.262882+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:37.265798\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:03:43.986 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[108361]: audit 2023-07-20T15:03:43.349589+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDkAw6JakBEEbus1ZIuGEfFMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjMwNzIwMTUwMzQzWhcN\nMzMwNzE3MTUwMzQzWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAzE4C7zsRmhPGZac31XMs\n4WtTMaSKtZqqPrrrxQN25C+2pxnQ1WzASQwJTP4oFF2KTFB+cfWC8exI5h6iwC8d\nLflHOf6D/E6+z3qBKTq1s6yGHKU1kYOd2YEbjvESO/QbeMRg8//tNDqwEuBriA0U\nr7KOumjyQ4ixll3h/S4w3nGPocaH0tQGZVt8jaAn9RjOsNOBO84pJjJ1lpZdKRB7\nIKaB9OipurH7cBoxw5O/PffQnkxFMZjRn1rytYyK5LGjcyaO9HYGr50pYlfRzmeQ\nkEBB9M64yyzDQo95toRG+FOm3b3Kcy5ZvdgPJGKkUwfhEKI79IpUXL3zQNmamquB\n2QIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQARi5W/9RRqjRwM1iAV0VlCYzshKMeF\n85r8bfgyWQx65/rdekaO0D83Z2v5tAs3px+bSN170U1H9Wz/Abe9a+6PI3wGOt8w\nEPIBFkMfDOGr1cstiLfFx+TUlwzI16XraImOpVRoUk5nClpJhC2gWGDT1yQItrJu\nklqJuzZFkRV7kw99Vew5YwCeT9W7iWzGbAS0EgXtXwrH9Ihm1fHP7taeuLEVembU\nQEk8KL/3a8qFcZixE2bIN5iX66OLhJ/JJboN72+IjFbc8YgMo7K9GgqxGdn34Dkh\nP6yQZFPhDUL9to9wHFCiUDItxS6PjP+7BHrbxIwPstrwaxn7C3ecAZqL\n-----END CERTIFICATE-----\n"}]: dispatch 2023-07-20T15:03:43.986 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[108361]: audit 2023-07-20T15:03:43.352625+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDkAw6JakBEEbus1ZIuGEfFMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjMwNzIwMTUwMzQzWhcN\nMzMwNzE3MTUwMzQzWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAzE4C7zsRmhPGZac31XMs\n4WtTMaSKtZqqPrrrxQN25C+2pxnQ1WzASQwJTP4oFF2KTFB+cfWC8exI5h6iwC8d\nLflHOf6D/E6+z3qBKTq1s6yGHKU1kYOd2YEbjvESO/QbeMRg8//tNDqwEuBriA0U\nr7KOumjyQ4ixll3h/S4w3nGPocaH0tQGZVt8jaAn9RjOsNOBO84pJjJ1lpZdKRB7\nIKaB9OipurH7cBoxw5O/PffQnkxFMZjRn1rytYyK5LGjcyaO9HYGr50pYlfRzmeQ\nkEBB9M64yyzDQo95toRG+FOm3b3Kcy5ZvdgPJGKkUwfhEKI79IpUXL3zQNmamquB\n2QIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQARi5W/9RRqjRwM1iAV0VlCYzshKMeF\n85r8bfgyWQx65/rdekaO0D83Z2v5tAs3px+bSN170U1H9Wz/Abe9a+6PI3wGOt8w\nEPIBFkMfDOGr1cstiLfFx+TUlwzI16XraImOpVRoUk5nClpJhC2gWGDT1yQItrJu\nklqJuzZFkRV7kw99Vew5YwCeT9W7iWzGbAS0EgXtXwrH9Ihm1fHP7taeuLEVembU\nQEk8KL/3a8qFcZixE2bIN5iX66OLhJ/JJboN72+IjFbc8YgMo7K9GgqxGdn34Dkh\nP6yQZFPhDUL9to9wHFCiUDItxS6PjP+7BHrbxIwPstrwaxn7C3ecAZqL\n-----END CERTIFICATE-----\n"}]': finished 2023-07-20T15:03:43.986 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[108361]: audit 2023-07-20T15:03:43.353068+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDMTgLvOxGaE8Zl\npzfVcyzha1MxpIq1mqo+uuvFA3bkL7anGdDVbMBJDAlM/igUXYpMUH5x9YLx7Ejm\nHqLALx0t+Uc5/oP8Tr7PeoEpOrWzrIYcpTWRg53ZgRuO8RI79Bt4xGDz/+00OrAS\n4GuIDRSvso66aPJDiLGWXeH9LjDecY+hxofS1AZlW3yNoCf1GM6w04E7zikmMnWW\nll0pEHsgpoH06Km6sftwGjHDk78999CeTEUxmNGfWvK1jIrksaNzJo70dgavnSli\nV9HOZ5CQQEH0zrjLLMNCj3m2hEb4U6bdvcpzLlm92A8kYqRTB+EQojv0ilRcvfNA\n2Zqaq4HZAgMBAAECggEBAKXca2t2Y+rXRQj/wUdLctMqg2bY8zdN8gptS70s+9dy\nmPF99tldqZlj6SUVbMpjykP8UTsJGx52OhSAKJanaSQKrPV7GAG8mBHunW8wV5Uf\nad1VjnCtDngm5Y2dTrVXjvnzS9arHhJ51rnsccAJBpNA/bh+PLfxAGNXooEdf9UF\nnz/JCYqsHsWNHLTpCFCGaiL0qkaT7FPnTXjVeJOmqNAQ6KmQXDArsmkrks/zSqV8\nvRkN/2GZma3nEJIk3mB+mawNZJ+56UeFFASamuGyf8zcX5kHwToPe3omQUAoMOkV\nwKnIz2VNOxKnaXsdtW/BTfnbH/PIbW+Y5nPoUY47JEUCgYEA50tKAqsYrP5TEhQI\nhAFh1TF8KIn44F2AxfYCIkoZ4wDuSHtpdPUVYMH9yhuZWY736wTnryU1PClsZ4M0\n9i4w7mdu3zrAgRaAsAmulis+vwMBgBo2BBRaSqAYHstQWlAInTgmmeGXzLO/zLlm\nnmGtU4CJovTY5eTjNbOBL5Bh6q8CgYEA4iCzgpUYhzIii94BpKqPkcSEqSmNyh64\n2ULdO+tWZm+hs+wTLEggV6kI6c1QweEZx8S2CgsEjcdqx/1sGYtcvWe4KhGfpzlg\n276gAb9vbRMbcpryf5Ny5q1cZhWenHnWxZ0E1ciHSqeW/a6WEqXe9ZLwcio9c8LD\nqLgLX3c33fcCgYA2NlZtk67f9WiBJ0Lrtes5bjTcx6IW7LOfMs9DPD0fEPvI72xD\nZqKRIEcdFST3ceQ4KNkpGz6EEG2BQaarQR5k8sdw+TNfzmdxW4OZXR+C4/B5Fyur\n/x0+upGMvjjiQjoSp7Ocg9zxtPvyv04HN3vJw6n/EQa5s9Fxp9ZS0LOyrwKBgGW5\nZEe4HsKi8RuOkZqsB84BY9RdlyV30JwcEj4kTkfirBGuf6mKANKufg3/iPbO9rQB\ncArwjenh7c1t2bVcFio2gIicSQAHNeVkycI/hjbBQ7W4sqJliGjxUAG0dBfcT5uy\nWTx66zHQVoJkiap15+j9YyFYkzCCS1aZBLS7guxdAoGAFzOrtxgtWSvMg/IVObSw\nbiMXtOE+ZXuwpnGULbBu5hVriIKi2I/3LzXgud5mgGw0scwPnknfyDqfHSv1FrAf\ndHjUUe0pJb5dRZpxSnhhKmzuB8XRsmvZgqYP94DSy7KhDCEMJzCvuh84ibAIORmc\nAgFwamkk9jFkC8CmSYZAx7o=\n-----END PRIVATE KEY-----\n"}]: dispatch 2023-07-20T15:03:43.987 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:43 smithi029 bash[108361]: audit 2023-07-20T15:03:43.355301+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDMTgLvOxGaE8Zl\npzfVcyzha1MxpIq1mqo+uuvFA3bkL7anGdDVbMBJDAlM/igUXYpMUH5x9YLx7Ejm\nHqLALx0t+Uc5/oP8Tr7PeoEpOrWzrIYcpTWRg53ZgRuO8RI79Bt4xGDz/+00OrAS\n4GuIDRSvso66aPJDiLGWXeH9LjDecY+hxofS1AZlW3yNoCf1GM6w04E7zikmMnWW\nll0pEHsgpoH06Km6sftwGjHDk78999CeTEUxmNGfWvK1jIrksaNzJo70dgavnSli\nV9HOZ5CQQEH0zrjLLMNCj3m2hEb4U6bdvcpzLlm92A8kYqRTB+EQojv0ilRcvfNA\n2Zqaq4HZAgMBAAECggEBAKXca2t2Y+rXRQj/wUdLctMqg2bY8zdN8gptS70s+9dy\nmPF99tldqZlj6SUVbMpjykP8UTsJGx52OhSAKJanaSQKrPV7GAG8mBHunW8wV5Uf\nad1VjnCtDngm5Y2dTrVXjvnzS9arHhJ51rnsccAJBpNA/bh+PLfxAGNXooEdf9UF\nnz/JCYqsHsWNHLTpCFCGaiL0qkaT7FPnTXjVeJOmqNAQ6KmQXDArsmkrks/zSqV8\nvRkN/2GZma3nEJIk3mB+mawNZJ+56UeFFASamuGyf8zcX5kHwToPe3omQUAoMOkV\nwKnIz2VNOxKnaXsdtW/BTfnbH/PIbW+Y5nPoUY47JEUCgYEA50tKAqsYrP5TEhQI\nhAFh1TF8KIn44F2AxfYCIkoZ4wDuSHtpdPUVYMH9yhuZWY736wTnryU1PClsZ4M0\n9i4w7mdu3zrAgRaAsAmulis+vwMBgBo2BBRaSqAYHstQWlAInTgmmeGXzLO/zLlm\nnmGtU4CJovTY5eTjNbOBL5Bh6q8CgYEA4iCzgpUYhzIii94BpKqPkcSEqSmNyh64\n2ULdO+tWZm+hs+wTLEggV6kI6c1QweEZx8S2CgsEjcdqx/1sGYtcvWe4KhGfpzlg\n276gAb9vbRMbcpryf5Ny5q1cZhWenHnWxZ0E1ciHSqeW/a6WEqXe9ZLwcio9c8LD\nqLgLX3c33fcCgYA2NlZtk67f9WiBJ0Lrtes5bjTcx6IW7LOfMs9DPD0fEPvI72xD\nZqKRIEcdFST3ceQ4KNkpGz6EEG2BQaarQR5k8sdw+TNfzmdxW4OZXR+C4/B5Fyur\n/x0+upGMvjjiQjoSp7Ocg9zxtPvyv04HN3vJw6n/EQa5s9Fxp9ZS0LOyrwKBgGW5\nZEe4HsKi8RuOkZqsB84BY9RdlyV30JwcEj4kTkfirBGuf6mKANKufg3/iPbO9rQB\ncArwjenh7c1t2bVcFio2gIicSQAHNeVkycI/hjbBQ7W4sqJliGjxUAG0dBfcT5uy\nWTx66zHQVoJkiap15+j9YyFYkzCCS1aZBLS7guxdAoGAFzOrtxgtWSvMg/IVObSw\nbiMXtOE+ZXuwpnGULbBu5hVriIKi2I/3LzXgud5mgGw0scwPnknfyDqfHSv1FrAf\ndHjUUe0pJb5dRZpxSnhhKmzuB8XRsmvZgqYP94DSy7KhDCEMJzCvuh84ibAIORmc\nAgFwamkk9jFkC8CmSYZAx7o=\n-----END PRIVATE KEY-----\n"}]': finished 2023-07-20T15:03:44.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:43 smithi178 bash[104918]: audit 2023-07-20T15:03:43.259837+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:37.265798\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:03:44.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:43 smithi178 bash[104918]: audit 2023-07-20T15:03:43.262882+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149044\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149120\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149155\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149186\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149216\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149260\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:02:26.149294\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:37.265798\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:03:44.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:43 smithi178 bash[104918]: audit 2023-07-20T15:03:43.349589+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDkAw6JakBEEbus1ZIuGEfFMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjMwNzIwMTUwMzQzWhcN\nMzMwNzE3MTUwMzQzWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAzE4C7zsRmhPGZac31XMs\n4WtTMaSKtZqqPrrrxQN25C+2pxnQ1WzASQwJTP4oFF2KTFB+cfWC8exI5h6iwC8d\nLflHOf6D/E6+z3qBKTq1s6yGHKU1kYOd2YEbjvESO/QbeMRg8//tNDqwEuBriA0U\nr7KOumjyQ4ixll3h/S4w3nGPocaH0tQGZVt8jaAn9RjOsNOBO84pJjJ1lpZdKRB7\nIKaB9OipurH7cBoxw5O/PffQnkxFMZjRn1rytYyK5LGjcyaO9HYGr50pYlfRzmeQ\nkEBB9M64yyzDQo95toRG+FOm3b3Kcy5ZvdgPJGKkUwfhEKI79IpUXL3zQNmamquB\n2QIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQARi5W/9RRqjRwM1iAV0VlCYzshKMeF\n85r8bfgyWQx65/rdekaO0D83Z2v5tAs3px+bSN170U1H9Wz/Abe9a+6PI3wGOt8w\nEPIBFkMfDOGr1cstiLfFx+TUlwzI16XraImOpVRoUk5nClpJhC2gWGDT1yQItrJu\nklqJuzZFkRV7kw99Vew5YwCeT9W7iWzGbAS0EgXtXwrH9Ihm1fHP7taeuLEVembU\nQEk8KL/3a8qFcZixE2bIN5iX66OLhJ/JJboN72+IjFbc8YgMo7K9GgqxGdn34Dkh\nP6yQZFPhDUL9to9wHFCiUDItxS6PjP+7BHrbxIwPstrwaxn7C3ecAZqL\n-----END CERTIFICATE-----\n"}]: dispatch 2023-07-20T15:03:44.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:43 smithi178 bash[104918]: audit 2023-07-20T15:03:43.352625+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDkAw6JakBEEbus1ZIuGEfFMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjMwNzIwMTUwMzQzWhcN\nMzMwNzE3MTUwMzQzWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAzE4C7zsRmhPGZac31XMs\n4WtTMaSKtZqqPrrrxQN25C+2pxnQ1WzASQwJTP4oFF2KTFB+cfWC8exI5h6iwC8d\nLflHOf6D/E6+z3qBKTq1s6yGHKU1kYOd2YEbjvESO/QbeMRg8//tNDqwEuBriA0U\nr7KOumjyQ4ixll3h/S4w3nGPocaH0tQGZVt8jaAn9RjOsNOBO84pJjJ1lpZdKRB7\nIKaB9OipurH7cBoxw5O/PffQnkxFMZjRn1rytYyK5LGjcyaO9HYGr50pYlfRzmeQ\nkEBB9M64yyzDQo95toRG+FOm3b3Kcy5ZvdgPJGKkUwfhEKI79IpUXL3zQNmamquB\n2QIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQARi5W/9RRqjRwM1iAV0VlCYzshKMeF\n85r8bfgyWQx65/rdekaO0D83Z2v5tAs3px+bSN170U1H9Wz/Abe9a+6PI3wGOt8w\nEPIBFkMfDOGr1cstiLfFx+TUlwzI16XraImOpVRoUk5nClpJhC2gWGDT1yQItrJu\nklqJuzZFkRV7kw99Vew5YwCeT9W7iWzGbAS0EgXtXwrH9Ihm1fHP7taeuLEVembU\nQEk8KL/3a8qFcZixE2bIN5iX66OLhJ/JJboN72+IjFbc8YgMo7K9GgqxGdn34Dkh\nP6yQZFPhDUL9to9wHFCiUDItxS6PjP+7BHrbxIwPstrwaxn7C3ecAZqL\n-----END CERTIFICATE-----\n"}]': finished 2023-07-20T15:03:44.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:43 smithi178 bash[104918]: audit 2023-07-20T15:03:43.353068+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDMTgLvOxGaE8Zl\npzfVcyzha1MxpIq1mqo+uuvFA3bkL7anGdDVbMBJDAlM/igUXYpMUH5x9YLx7Ejm\nHqLALx0t+Uc5/oP8Tr7PeoEpOrWzrIYcpTWRg53ZgRuO8RI79Bt4xGDz/+00OrAS\n4GuIDRSvso66aPJDiLGWXeH9LjDecY+hxofS1AZlW3yNoCf1GM6w04E7zikmMnWW\nll0pEHsgpoH06Km6sftwGjHDk78999CeTEUxmNGfWvK1jIrksaNzJo70dgavnSli\nV9HOZ5CQQEH0zrjLLMNCj3m2hEb4U6bdvcpzLlm92A8kYqRTB+EQojv0ilRcvfNA\n2Zqaq4HZAgMBAAECggEBAKXca2t2Y+rXRQj/wUdLctMqg2bY8zdN8gptS70s+9dy\nmPF99tldqZlj6SUVbMpjykP8UTsJGx52OhSAKJanaSQKrPV7GAG8mBHunW8wV5Uf\nad1VjnCtDngm5Y2dTrVXjvnzS9arHhJ51rnsccAJBpNA/bh+PLfxAGNXooEdf9UF\nnz/JCYqsHsWNHLTpCFCGaiL0qkaT7FPnTXjVeJOmqNAQ6KmQXDArsmkrks/zSqV8\nvRkN/2GZma3nEJIk3mB+mawNZJ+56UeFFASamuGyf8zcX5kHwToPe3omQUAoMOkV\nwKnIz2VNOxKnaXsdtW/BTfnbH/PIbW+Y5nPoUY47JEUCgYEA50tKAqsYrP5TEhQI\nhAFh1TF8KIn44F2AxfYCIkoZ4wDuSHtpdPUVYMH9yhuZWY736wTnryU1PClsZ4M0\n9i4w7mdu3zrAgRaAsAmulis+vwMBgBo2BBRaSqAYHstQWlAInTgmmeGXzLO/zLlm\nnmGtU4CJovTY5eTjNbOBL5Bh6q8CgYEA4iCzgpUYhzIii94BpKqPkcSEqSmNyh64\n2ULdO+tWZm+hs+wTLEggV6kI6c1QweEZx8S2CgsEjcdqx/1sGYtcvWe4KhGfpzlg\n276gAb9vbRMbcpryf5Ny5q1cZhWenHnWxZ0E1ciHSqeW/a6WEqXe9ZLwcio9c8LD\nqLgLX3c33fcCgYA2NlZtk67f9WiBJ0Lrtes5bjTcx6IW7LOfMs9DPD0fEPvI72xD\nZqKRIEcdFST3ceQ4KNkpGz6EEG2BQaarQR5k8sdw+TNfzmdxW4OZXR+C4/B5Fyur\n/x0+upGMvjjiQjoSp7Ocg9zxtPvyv04HN3vJw6n/EQa5s9Fxp9ZS0LOyrwKBgGW5\nZEe4HsKi8RuOkZqsB84BY9RdlyV30JwcEj4kTkfirBGuf6mKANKufg3/iPbO9rQB\ncArwjenh7c1t2bVcFio2gIicSQAHNeVkycI/hjbBQ7W4sqJliGjxUAG0dBfcT5uy\nWTx66zHQVoJkiap15+j9YyFYkzCCS1aZBLS7guxdAoGAFzOrtxgtWSvMg/IVObSw\nbiMXtOE+ZXuwpnGULbBu5hVriIKi2I/3LzXgud5mgGw0scwPnknfyDqfHSv1FrAf\ndHjUUe0pJb5dRZpxSnhhKmzuB8XRsmvZgqYP94DSy7KhDCEMJzCvuh84ibAIORmc\nAgFwamkk9jFkC8CmSYZAx7o=\n-----END PRIVATE KEY-----\n"}]: dispatch 2023-07-20T15:03:44.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:43 smithi178 bash[104918]: audit 2023-07-20T15:03:43.355301+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDMTgLvOxGaE8Zl\npzfVcyzha1MxpIq1mqo+uuvFA3bkL7anGdDVbMBJDAlM/igUXYpMUH5x9YLx7Ejm\nHqLALx0t+Uc5/oP8Tr7PeoEpOrWzrIYcpTWRg53ZgRuO8RI79Bt4xGDz/+00OrAS\n4GuIDRSvso66aPJDiLGWXeH9LjDecY+hxofS1AZlW3yNoCf1GM6w04E7zikmMnWW\nll0pEHsgpoH06Km6sftwGjHDk78999CeTEUxmNGfWvK1jIrksaNzJo70dgavnSli\nV9HOZ5CQQEH0zrjLLMNCj3m2hEb4U6bdvcpzLlm92A8kYqRTB+EQojv0ilRcvfNA\n2Zqaq4HZAgMBAAECggEBAKXca2t2Y+rXRQj/wUdLctMqg2bY8zdN8gptS70s+9dy\nmPF99tldqZlj6SUVbMpjykP8UTsJGx52OhSAKJanaSQKrPV7GAG8mBHunW8wV5Uf\nad1VjnCtDngm5Y2dTrVXjvnzS9arHhJ51rnsccAJBpNA/bh+PLfxAGNXooEdf9UF\nnz/JCYqsHsWNHLTpCFCGaiL0qkaT7FPnTXjVeJOmqNAQ6KmQXDArsmkrks/zSqV8\nvRkN/2GZma3nEJIk3mB+mawNZJ+56UeFFASamuGyf8zcX5kHwToPe3omQUAoMOkV\nwKnIz2VNOxKnaXsdtW/BTfnbH/PIbW+Y5nPoUY47JEUCgYEA50tKAqsYrP5TEhQI\nhAFh1TF8KIn44F2AxfYCIkoZ4wDuSHtpdPUVYMH9yhuZWY736wTnryU1PClsZ4M0\n9i4w7mdu3zrAgRaAsAmulis+vwMBgBo2BBRaSqAYHstQWlAInTgmmeGXzLO/zLlm\nnmGtU4CJovTY5eTjNbOBL5Bh6q8CgYEA4iCzgpUYhzIii94BpKqPkcSEqSmNyh64\n2ULdO+tWZm+hs+wTLEggV6kI6c1QweEZx8S2CgsEjcdqx/1sGYtcvWe4KhGfpzlg\n276gAb9vbRMbcpryf5Ny5q1cZhWenHnWxZ0E1ciHSqeW/a6WEqXe9ZLwcio9c8LD\nqLgLX3c33fcCgYA2NlZtk67f9WiBJ0Lrtes5bjTcx6IW7LOfMs9DPD0fEPvI72xD\nZqKRIEcdFST3ceQ4KNkpGz6EEG2BQaarQR5k8sdw+TNfzmdxW4OZXR+C4/B5Fyur\n/x0+upGMvjjiQjoSp7Ocg9zxtPvyv04HN3vJw6n/EQa5s9Fxp9ZS0LOyrwKBgGW5\nZEe4HsKi8RuOkZqsB84BY9RdlyV30JwcEj4kTkfirBGuf6mKANKufg3/iPbO9rQB\ncArwjenh7c1t2bVcFio2gIicSQAHNeVkycI/hjbBQ7W4sqJliGjxUAG0dBfcT5uy\nWTx66zHQVoJkiap15+j9YyFYkzCCS1aZBLS7guxdAoGAFzOrtxgtWSvMg/IVObSw\nbiMXtOE+ZXuwpnGULbBu5hVriIKi2I/3LzXgud5mgGw0scwPnknfyDqfHSv1FrAf\ndHjUUe0pJb5dRZpxSnhhKmzuB8XRsmvZgqYP94DSy7KhDCEMJzCvuh84ibAIORmc\nAgFwamkk9jFkC8CmSYZAx7o=\n-----END PRIVATE KEY-----\n"}]': finished 2023-07-20T15:03:44.248 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-07-20T15:03:44.611 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-20T15:03:44.612 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-07-20T15:03:44.613 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph mgr dump --format=json 2023-07-20T15:03:45.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:44 smithi178 bash[104918]: cephadm 2023-07-20T15:03:43.355840+0000 mgr.y (mgr.14142) 151 : cephadm [INF] Deploying daemon grafana.a on smithi178 2023-07-20T15:03:45.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:44 smithi178 bash[104918]: cluster 2023-07-20T15:03:43.814715+0000 mgr.y (mgr.14142) 152 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:45.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:44 smithi178 bash[104918]: audit 2023-07-20T15:03:44.203313+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.29:0/956170038' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2023-07-20T15:03:45.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:44 smithi029 bash[104935]: cephadm 2023-07-20T15:03:43.355840+0000 mgr.y (mgr.14142) 151 : cephadm [INF] Deploying daemon grafana.a on smithi178 2023-07-20T15:03:45.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:44 smithi029 bash[104935]: cluster 2023-07-20T15:03:43.814715+0000 mgr.y (mgr.14142) 152 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:45.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:44 smithi029 bash[104935]: audit 2023-07-20T15:03:44.203313+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.29:0/956170038' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2023-07-20T15:03:45.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:44 smithi029 bash[108361]: cephadm 2023-07-20T15:03:43.355840+0000 mgr.y (mgr.14142) 151 : cephadm [INF] Deploying daemon grafana.a on smithi178 2023-07-20T15:03:45.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:44 smithi029 bash[108361]: cluster 2023-07-20T15:03:43.814715+0000 mgr.y (mgr.14142) 152 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:45.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:44 smithi029 bash[108361]: audit 2023-07-20T15:03:44.203313+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.29:0/956170038' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2023-07-20T15:03:45.790 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T15:03:46.076 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:45 smithi029 bash[104935]: audit 2023-07-20T15:03:45.739430+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.29:0/256702930' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-07-20T15:03:46.077 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:45 smithi029 bash[108361]: audit 2023-07-20T15:03:45.739430+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.29:0/256702930' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-07-20T15:03:46.077 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:45 smithi029 bash[119224]: ts=2023-07-20T15:03:45.737Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.00058885s 2023-07-20T15:03:46.149 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":14,"active_gid":14142,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":4040478195},{"type":"v1","addr":"172.21.15.29:6801","nonce":4040478195}]},"active_addr":"172.21.15.29:6801/4040478195","active_change":"2023-07-20T15:00:15.623363+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":34109,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi029.front.sepia.ceph.com:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":5,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":990615207}]},{"addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":3981441707}]},{"addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":1786231591}]}]}} 2023-07-20T15:03:46.153 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-07-20T15:03:46.154 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-07-20T15:03:46.154 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph osd dump --format=json 2023-07-20T15:03:46.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:45 smithi178 bash[104918]: audit 2023-07-20T15:03:45.739430+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.29:0/256702930' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-07-20T15:03:47.005 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:46 smithi029 bash[104935]: cluster 2023-07-20T15:03:45.815155+0000 mgr.y (mgr.14142) 153 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:47.017 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:46 smithi029 bash[108361]: cluster 2023-07-20T15:03:45.815155+0000 mgr.y (mgr.14142) 153 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:47.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:46 smithi178 bash[104918]: cluster 2023-07-20T15:03:45.815155+0000 mgr.y (mgr.14142) 153 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:47.333 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T15:03:47.334 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":61,"fsid":"021c9860-270e-11ee-9b34-001a4aab830c","created":"2023-07-20T14:59:41.581865+0000","modified":"2023-07-20T15:03:23.938648+0000","last_up_change":"2023-07-20T15:03:22.932676+0000","last_in_change":"2023-07-20T15:03:22.932676+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-20T14:59:50.222865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"f8465b78-5108-4a6c-8741-1aacec147eb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":12,"up_from":14,"up_thru":59,"down_at":13,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1634899187},{"type":"v1","addr":"172.21.15.29:6803","nonce":1634899187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1634899187},{"type":"v1","addr":"172.21.15.29:6805","nonce":1634899187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1634899187},{"type":"v1","addr":"172.21.15.29:6809","nonce":1634899187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1634899187},{"type":"v1","addr":"172.21.15.29:6807","nonce":1634899187}]},"public_addr":"172.21.15.29:6803/1634899187","cluster_addr":"172.21.15.29:6805/1634899187","heartbeat_back_addr":"172.21.15.29:6809/1634899187","heartbeat_front_addr":"172.21.15.29:6807/1634899187","state":["exists","up"]},{"osd":1,"uuid":"0f51402c-d77b-420c-801b-5b204f09a8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":17,"last_clean_end":18,"up_from":20,"up_thru":40,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1986287135},{"type":"v1","addr":"172.21.15.29:6811","nonce":1986287135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1986287135},{"type":"v1","addr":"172.21.15.29:6813","nonce":1986287135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":1986287135},{"type":"v1","addr":"172.21.15.29:6817","nonce":1986287135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1986287135},{"type":"v1","addr":"172.21.15.29:6815","nonce":1986287135}]},"public_addr":"172.21.15.29:6811/1986287135","cluster_addr":"172.21.15.29:6813/1986287135","heartbeat_back_addr":"172.21.15.29:6817/1986287135","heartbeat_front_addr":"172.21.15.29:6815/1986287135","state":["exists","up"]},{"osd":2,"uuid":"2a028cba-0ec6-4032-96ef-177180fe78cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":23,"last_clean_end":24,"up_from":27,"up_thru":0,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":775038871},{"type":"v1","addr":"172.21.15.29:6819","nonce":775038871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":775038871},{"type":"v1","addr":"172.21.15.29:6821","nonce":775038871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":775038871},{"type":"v1","addr":"172.21.15.29:6825","nonce":775038871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":775038871},{"type":"v1","addr":"172.21.15.29:6823","nonce":775038871}]},"public_addr":"172.21.15.29:6819/775038871","cluster_addr":"172.21.15.29:6821/775038871","heartbeat_back_addr":"172.21.15.29:6825/775038871","heartbeat_front_addr":"172.21.15.29:6823/775038871","state":["exists","up"]},{"osd":3,"uuid":"4d7d62a7-fee8-4b91-aaef-43c33da61525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":3537910860},{"type":"v1","addr":"172.21.15.29:6827","nonce":3537910860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":3537910860},{"type":"v1","addr":"172.21.15.29:6829","nonce":3537910860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3537910860},{"type":"v1","addr":"172.21.15.29:6833","nonce":3537910860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":3537910860},{"type":"v1","addr":"172.21.15.29:6831","nonce":3537910860}]},"public_addr":"172.21.15.29:6827/3537910860","cluster_addr":"172.21.15.29:6829/3537910860","heartbeat_back_addr":"172.21.15.29:6833/3537910860","heartbeat_front_addr":"172.21.15.29:6831/3537910860","state":["exists","up"]},{"osd":4,"uuid":"e424090f-0486-4402-887d-f4fc310d93d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":37,"up_from":40,"up_thru":0,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":915448555},{"type":"v1","addr":"172.21.15.178:6801","nonce":915448555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":915448555},{"type":"v1","addr":"172.21.15.178:6803","nonce":915448555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":915448555},{"type":"v1","addr":"172.21.15.178:6807","nonce":915448555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":915448555},{"type":"v1","addr":"172.21.15.178:6805","nonce":915448555}]},"public_addr":"172.21.15.178:6801/915448555","cluster_addr":"172.21.15.178:6803/915448555","heartbeat_back_addr":"172.21.15.178:6807/915448555","heartbeat_front_addr":"172.21.15.178:6805/915448555","state":["exists","up"]},{"osd":5,"uuid":"7ff93523-43ae-478c-a87c-1044653beb64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":44,"last_clean_end":45,"up_from":48,"up_thru":48,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3613532761},{"type":"v1","addr":"172.21.15.178:6809","nonce":3613532761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3613532761},{"type":"v1","addr":"172.21.15.178:6811","nonce":3613532761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3613532761},{"type":"v1","addr":"172.21.15.178:6815","nonce":3613532761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3613532761},{"type":"v1","addr":"172.21.15.178:6813","nonce":3613532761}]},"public_addr":"172.21.15.178:6809/3613532761","cluster_addr":"172.21.15.178:6811/3613532761","heartbeat_back_addr":"172.21.15.178:6815/3613532761","heartbeat_front_addr":"172.21.15.178:6813/3613532761","state":["exists","up"]},{"osd":6,"uuid":"7a34c575-fbe7-465c-9f28-cdd42b784e43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":52,"last_clean_end":54,"up_from":57,"up_thru":57,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3503656327},{"type":"v1","addr":"172.21.15.178:6817","nonce":3503656327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3503656327},{"type":"v1","addr":"172.21.15.178:6819","nonce":3503656327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3503656327},{"type":"v1","addr":"172.21.15.178:6823","nonce":3503656327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3503656327},{"type":"v1","addr":"172.21.15.178:6821","nonce":3503656327}]},"public_addr":"172.21.15.178:6817/3503656327","cluster_addr":"172.21.15.178:6819/3503656327","heartbeat_back_addr":"172.21.15.178:6823/3503656327","heartbeat_front_addr":"172.21.15.178:6821/3503656327","state":["exists","up"]},{"osd":7,"uuid":"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3700445879},{"type":"v1","addr":"172.21.15.178:6825","nonce":3700445879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3700445879},{"type":"v1","addr":"172.21.15.178:6827","nonce":3700445879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3700445879},{"type":"v1","addr":"172.21.15.178:6831","nonce":3700445879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3700445879},{"type":"v1","addr":"172.21.15.178:6829","nonce":3700445879}]},"public_addr":"172.21.15.178:6825/3700445879","cluster_addr":"172.21.15.178:6827/3700445879","heartbeat_back_addr":"172.21.15.178:6831/3700445879","heartbeat_front_addr":"172.21.15.178:6829/3700445879","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2023-07-20T15:01:54.129144+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:01:41.900784+0000","dead_epoch":0},{"osd":1,"down_stamp":"2023-07-20T15:02:08.839614+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:01:56.629575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:02:11.666801+0000","dead_epoch":25},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:02:26.130345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:02:36.472369+0000","dead_epoch":38},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:02:52.041872+0000","dead_epoch":46},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:03:06.765870+0000","dead_epoch":55},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:03:21.664196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.29:6800/3325065975":"2023-07-21T15:00:15.623050+0000","172.21.15.29:6801/3325065975":"2023-07-21T15:00:15.623050+0000","172.21.15.29:0/4240559759":"2023-07-21T15:00:15.623050+0000","172.21.15.29:0/2115661188":"2023-07-21T15:00:15.623050+0000","172.21.15.29:0/3952452472":"2023-07-21T15:00:15.623050+0000","172.21.15.29:0/3782113586":"2023-07-21T14:59:58.056221+0000","172.21.15.29:6801/2412527169":"2023-07-21T14:59:58.056221+0000","172.21.15.29:0/784956587":"2023-07-21T14:59:58.056221+0000","172.21.15.29:6800/2412527169":"2023-07-21T14:59:58.056221+0000","172.21.15.29:0/3979765469":"2023-07-21T14:59:58.056221+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-07-20T15:03:47.693 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-07-20T15:03:47.693 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph osd dump --format=json 2023-07-20T15:03:48.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:47 smithi178 bash[104918]: audit 2023-07-20T15:03:47.286899+0000 mon.a (mon.0) 708 : audit [DBG] from='client.? 172.21.15.29:0/2066175424' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-20T15:03:48.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:47 smithi029 bash[104935]: audit 2023-07-20T15:03:47.286899+0000 mon.a (mon.0) 708 : audit [DBG] from='client.? 172.21.15.29:0/2066175424' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-20T15:03:48.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:47 smithi029 bash[108361]: audit 2023-07-20T15:03:47.286899+0000 mon.a (mon.0) 708 : audit [DBG] from='client.? 172.21.15.29:0/2066175424' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-20T15:03:48.900 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T15:03:48.901 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":61,"fsid":"021c9860-270e-11ee-9b34-001a4aab830c","created":"2023-07-20T14:59:41.581865+0000","modified":"2023-07-20T15:03:23.938648+0000","last_up_change":"2023-07-20T15:03:22.932676+0000","last_in_change":"2023-07-20T15:03:22.932676+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-20T14:59:50.222865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"f8465b78-5108-4a6c-8741-1aacec147eb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":12,"up_from":14,"up_thru":59,"down_at":13,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1634899187},{"type":"v1","addr":"172.21.15.29:6803","nonce":1634899187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1634899187},{"type":"v1","addr":"172.21.15.29:6805","nonce":1634899187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1634899187},{"type":"v1","addr":"172.21.15.29:6809","nonce":1634899187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1634899187},{"type":"v1","addr":"172.21.15.29:6807","nonce":1634899187}]},"public_addr":"172.21.15.29:6803/1634899187","cluster_addr":"172.21.15.29:6805/1634899187","heartbeat_back_addr":"172.21.15.29:6809/1634899187","heartbeat_front_addr":"172.21.15.29:6807/1634899187","state":["exists","up"]},{"osd":1,"uuid":"0f51402c-d77b-420c-801b-5b204f09a8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":17,"last_clean_end":18,"up_from":20,"up_thru":40,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1986287135},{"type":"v1","addr":"172.21.15.29:6811","nonce":1986287135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1986287135},{"type":"v1","addr":"172.21.15.29:6813","nonce":1986287135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":1986287135},{"type":"v1","addr":"172.21.15.29:6817","nonce":1986287135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1986287135},{"type":"v1","addr":"172.21.15.29:6815","nonce":1986287135}]},"public_addr":"172.21.15.29:6811/1986287135","cluster_addr":"172.21.15.29:6813/1986287135","heartbeat_back_addr":"172.21.15.29:6817/1986287135","heartbeat_front_addr":"172.21.15.29:6815/1986287135","state":["exists","up"]},{"osd":2,"uuid":"2a028cba-0ec6-4032-96ef-177180fe78cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":23,"last_clean_end":24,"up_from":27,"up_thru":0,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":775038871},{"type":"v1","addr":"172.21.15.29:6819","nonce":775038871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":775038871},{"type":"v1","addr":"172.21.15.29:6821","nonce":775038871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":775038871},{"type":"v1","addr":"172.21.15.29:6825","nonce":775038871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":775038871},{"type":"v1","addr":"172.21.15.29:6823","nonce":775038871}]},"public_addr":"172.21.15.29:6819/775038871","cluster_addr":"172.21.15.29:6821/775038871","heartbeat_back_addr":"172.21.15.29:6825/775038871","heartbeat_front_addr":"172.21.15.29:6823/775038871","state":["exists","up"]},{"osd":3,"uuid":"4d7d62a7-fee8-4b91-aaef-43c33da61525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":3537910860},{"type":"v1","addr":"172.21.15.29:6827","nonce":3537910860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":3537910860},{"type":"v1","addr":"172.21.15.29:6829","nonce":3537910860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3537910860},{"type":"v1","addr":"172.21.15.29:6833","nonce":3537910860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":3537910860},{"type":"v1","addr":"172.21.15.29:6831","nonce":3537910860}]},"public_addr":"172.21.15.29:6827/3537910860","cluster_addr":"172.21.15.29:6829/3537910860","heartbeat_back_addr":"172.21.15.29:6833/3537910860","heartbeat_front_addr":"172.21.15.29:6831/3537910860","state":["exists","up"]},{"osd":4,"uuid":"e424090f-0486-4402-887d-f4fc310d93d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":37,"up_from":40,"up_thru":0,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":915448555},{"type":"v1","addr":"172.21.15.178:6801","nonce":915448555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":915448555},{"type":"v1","addr":"172.21.15.178:6803","nonce":915448555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":915448555},{"type":"v1","addr":"172.21.15.178:6807","nonce":915448555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":915448555},{"type":"v1","addr":"172.21.15.178:6805","nonce":915448555}]},"public_addr":"172.21.15.178:6801/915448555","cluster_addr":"172.21.15.178:6803/915448555","heartbeat_back_addr":"172.21.15.178:6807/915448555","heartbeat_front_addr":"172.21.15.178:6805/915448555","state":["exists","up"]},{"osd":5,"uuid":"7ff93523-43ae-478c-a87c-1044653beb64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":44,"last_clean_end":45,"up_from":48,"up_thru":48,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3613532761},{"type":"v1","addr":"172.21.15.178:6809","nonce":3613532761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3613532761},{"type":"v1","addr":"172.21.15.178:6811","nonce":3613532761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3613532761},{"type":"v1","addr":"172.21.15.178:6815","nonce":3613532761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3613532761},{"type":"v1","addr":"172.21.15.178:6813","nonce":3613532761}]},"public_addr":"172.21.15.178:6809/3613532761","cluster_addr":"172.21.15.178:6811/3613532761","heartbeat_back_addr":"172.21.15.178:6815/3613532761","heartbeat_front_addr":"172.21.15.178:6813/3613532761","state":["exists","up"]},{"osd":6,"uuid":"7a34c575-fbe7-465c-9f28-cdd42b784e43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":52,"last_clean_end":54,"up_from":57,"up_thru":57,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3503656327},{"type":"v1","addr":"172.21.15.178:6817","nonce":3503656327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3503656327},{"type":"v1","addr":"172.21.15.178:6819","nonce":3503656327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3503656327},{"type":"v1","addr":"172.21.15.178:6823","nonce":3503656327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3503656327},{"type":"v1","addr":"172.21.15.178:6821","nonce":3503656327}]},"public_addr":"172.21.15.178:6817/3503656327","cluster_addr":"172.21.15.178:6819/3503656327","heartbeat_back_addr":"172.21.15.178:6823/3503656327","heartbeat_front_addr":"172.21.15.178:6821/3503656327","state":["exists","up"]},{"osd":7,"uuid":"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3700445879},{"type":"v1","addr":"172.21.15.178:6825","nonce":3700445879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3700445879},{"type":"v1","addr":"172.21.15.178:6827","nonce":3700445879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3700445879},{"type":"v1","addr":"172.21.15.178:6831","nonce":3700445879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3700445879},{"type":"v1","addr":"172.21.15.178:6829","nonce":3700445879}]},"public_addr":"172.21.15.178:6825/3700445879","cluster_addr":"172.21.15.178:6827/3700445879","heartbeat_back_addr":"172.21.15.178:6831/3700445879","heartbeat_front_addr":"172.21.15.178:6829/3700445879","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2023-07-20T15:01:54.129144+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:01:41.900784+0000","dead_epoch":0},{"osd":1,"down_stamp":"2023-07-20T15:02:08.839614+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:01:56.629575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:02:11.666801+0000","dead_epoch":25},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:02:26.130345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:02:36.472369+0000","dead_epoch":38},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:02:52.041872+0000","dead_epoch":46},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:03:06.765870+0000","dead_epoch":55},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T15:03:21.664196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.29:6800/3325065975":"2023-07-21T15:00:15.623050+0000","172.21.15.29:6801/3325065975":"2023-07-21T15:00:15.623050+0000","172.21.15.29:0/4240559759":"2023-07-21T15:00:15.623050+0000","172.21.15.29:0/2115661188":"2023-07-21T15:00:15.623050+0000","172.21.15.29:0/3952452472":"2023-07-21T15:00:15.623050+0000","172.21.15.29:0/3782113586":"2023-07-21T14:59:58.056221+0000","172.21.15.29:6801/2412527169":"2023-07-21T14:59:58.056221+0000","172.21.15.29:0/784956587":"2023-07-21T14:59:58.056221+0000","172.21.15.29:6800/2412527169":"2023-07-21T14:59:58.056221+0000","172.21.15.29:0/3979765469":"2023-07-21T14:59:58.056221+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-07-20T15:03:49.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:48 smithi178 bash[104918]: cluster 2023-07-20T15:03:47.815495+0000 mgr.y (mgr.14142) 154 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:49.193 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:48 smithi029 bash[104935]: cluster 2023-07-20T15:03:47.815495+0000 mgr.y (mgr.14142) 154 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:49.194 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:48 smithi029 bash[108361]: cluster 2023-07-20T15:03:47.815495+0000 mgr.y (mgr.14142) 154 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:49.219 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2023-07-20T15:03:50.162 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:49 smithi029 bash[104935]: audit 2023-07-20T15:03:48.855864+0000 mon.a (mon.0) 709 : audit [DBG] from='client.? 172.21.15.29:0/2330082581' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-20T15:03:50.163 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:49 smithi029 bash[108361]: audit 2023-07-20T15:03:48.855864+0000 mon.a (mon.0) 709 : audit [DBG] from='client.? 172.21.15.29:0/2330082581' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-20T15:03:50.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:49 smithi178 bash[104918]: audit 2023-07-20T15:03:48.855864+0000 mon.a (mon.0) 709 : audit [DBG] from='client.? 172.21.15.29:0/2330082581' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-20T15:03:50.659 INFO:teuthology.orchestra.run.smithi029.stdout:60129542169 2023-07-20T15:03:50.660 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2023-07-20T15:03:51.160 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:50 smithi178 bash[104918]: cluster 2023-07-20T15:03:49.815842+0000 mgr.y (mgr.14142) 155 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:51.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:50 smithi029 bash[104935]: cluster 2023-07-20T15:03:49.815842+0000 mgr.y (mgr.14142) 155 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:51.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:50 smithi029 bash[108361]: cluster 2023-07-20T15:03:49.815842+0000 mgr.y (mgr.14142) 155 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:52.069 INFO:teuthology.orchestra.run.smithi029.stdout:85899345942 2023-07-20T15:03:52.069 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2023-07-20T15:03:52.889 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:52 smithi178 podman[116251]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-grafana.a" found: no such container 2023-07-20T15:03:52.889 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:52 smithi178 systemd[1]: Started Ceph grafana.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:03:53.164 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:52 smithi029 bash[104935]: cluster 2023-07-20T15:03:51.816169+0000 mgr.y (mgr.14142) 156 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:53.165 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:52 smithi029 bash[108361]: cluster 2023-07-20T15:03:51.816169+0000 mgr.y (mgr.14142) 156 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:53.166 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:52 smithi029 bash[104935]: audit 2023-07-20T15:03:52.761045+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:53.166 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:52 smithi029 bash[104935]: audit 2023-07-20T15:03:52.763815+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:53.166 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:52 smithi029 bash[104935]: audit 2023-07-20T15:03:52.764583+0000 mon.a (mon.0) 712 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:53.166 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:52 smithi029 bash[108361]: audit 2023-07-20T15:03:52.761045+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:53.167 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:52 smithi029 bash[108361]: audit 2023-07-20T15:03:52.763815+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:53.167 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:52 smithi029 bash[108361]: audit 2023-07-20T15:03:52.764583+0000 mon.a (mon.0) 712 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:53.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:52 smithi178 bash[104918]: cluster 2023-07-20T15:03:51.816169+0000 mgr.y (mgr.14142) 156 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:53.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:52 smithi178 bash[104918]: audit 2023-07-20T15:03:52.761045+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:53.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:52 smithi178 bash[104918]: audit 2023-07-20T15:03:52.763815+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124334\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124411\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124447\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124478\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124508\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124538\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:36.124568\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:53.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:52 smithi178 bash[104918]: audit 2023-07-20T15:03:52.764583+0000 mon.a (mon.0) 712 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:53.619 INFO:teuthology.orchestra.run.smithi029.stdout:115964117011 2023-07-20T15:03:53.620 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2023-07-20T15:03:53.669 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Starting Grafana" logger=server version=6.6.2 commit=3fa63cfc34 branch=HEAD compiled=2020-02-20T12:03:49+0000 2023-07-20T15:03:53.670 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2023-07-20T15:03:53.670 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2023-07-20T15:03:53.670 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2023-07-20T15:03:53.670 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2023-07-20T15:03:53.671 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2023-07-20T15:03:53.671 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2023-07-20T15:03:53.671 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2023-07-20T15:03:53.672 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2023-07-20T15:03:53.672 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2023-07-20T15:03:53.672 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2023-07-20T15:03:53.672 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2023-07-20T15:03:53.672 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="App mode production" logger=settings 2023-07-20T15:03:53.672 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing SqlStore" logger=server 2023-07-20T15:03:53.672 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2023-07-20T15:03:53.672 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Starting DB migration" logger=migrator 2023-07-20T15:03:53.673 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2023-07-20T15:03:53.673 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2023-07-20T15:03:53.673 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2023-07-20T15:03:53.673 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2023-07-20T15:03:53.673 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2023-07-20T15:03:53.673 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2023-07-20T15:03:53.673 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2023-07-20T15:03:53.674 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2023-07-20T15:03:53.674 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2023-07-20T15:03:53.674 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2023-07-20T15:03:53.674 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2023-07-20T15:03:53.675 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2023-07-20T15:03:53.675 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2023-07-20T15:03:53.676 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2023-07-20T15:03:53.676 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2023-07-20T15:03:53.676 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2023-07-20T15:03:53.676 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2023-07-20T15:03:53.676 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2023-07-20T15:03:53.676 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2023-07-20T15:03:53.676 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2023-07-20T15:03:53.699 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2023-07-20T15:03:53.700 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2023-07-20T15:03:53.700 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2023-07-20T15:03:53.700 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2023-07-20T15:03:53.701 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2023-07-20T15:03:53.702 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2023-07-20T15:03:53.703 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2023-07-20T15:03:53.703 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2023-07-20T15:03:53.703 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2023-07-20T15:03:53.703 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2023-07-20T15:03:53.704 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2023-07-20T15:03:53.704 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2023-07-20T15:03:53.704 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2023-07-20T15:03:53.707 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2023-07-20T15:03:53.707 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2023-07-20T15:03:53.724 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2023-07-20T15:03:53.724 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2023-07-20T15:03:53.725 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2023-07-20T15:03:53.725 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2023-07-20T15:03:53.725 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2023-07-20T15:03:53.726 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2023-07-20T15:03:53.726 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2023-07-20T15:03:53.726 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2023-07-20T15:03:53.729 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2023-07-20T15:03:53.729 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2023-07-20T15:03:53.729 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2023-07-20T15:03:53.729 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2023-07-20T15:03:53.729 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2023-07-20T15:03:53.730 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2023-07-20T15:03:53.730 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2023-07-20T15:03:53.730 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2023-07-20T15:03:53.730 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2023-07-20T15:03:53.730 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2023-07-20T15:03:53.730 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2023-07-20T15:03:53.730 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2023-07-20T15:03:53.731 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2023-07-20T15:03:53.731 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2023-07-20T15:03:53.731 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2023-07-20T15:03:53.731 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2023-07-20T15:03:53.731 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2023-07-20T15:03:53.731 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2023-07-20T15:03:53.731 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2023-07-20T15:03:53.731 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2023-07-20T15:03:53.732 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2023-07-20T15:03:53.733 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2023-07-20T15:03:53.733 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2023-07-20T15:03:53.733 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2023-07-20T15:03:53.733 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2023-07-20T15:03:53.733 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2023-07-20T15:03:53.734 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2023-07-20T15:03:53.734 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2023-07-20T15:03:53.734 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2023-07-20T15:03:53.734 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2023-07-20T15:03:53.734 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2023-07-20T15:03:53.734 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2023-07-20T15:03:53.734 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2023-07-20T15:03:53.734 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2023-07-20T15:03:53.735 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2023-07-20T15:03:53.735 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2023-07-20T15:03:53.735 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2023-07-20T15:03:53.735 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2023-07-20T15:03:53.735 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2023-07-20T15:03:53.735 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2023-07-20T15:03:53.735 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2023-07-20T15:03:53.736 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2023-07-20T15:03:53.736 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2023-07-20T15:03:53.736 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2023-07-20T15:03:53.736 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2023-07-20T15:03:53.736 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2023-07-20T15:03:53.736 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2023-07-20T15:03:53.736 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2023-07-20T15:03:53.736 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2023-07-20T15:03:53.737 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2023-07-20T15:03:53.737 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2023-07-20T15:03:53.737 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2023-07-20T15:03:53.737 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2023-07-20T15:03:53.738 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2023-07-20T15:03:53.740 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2023-07-20T15:03:53.740 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2023-07-20T15:03:53.741 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2023-07-20T15:03:53.741 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2023-07-20T15:03:53.741 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2023-07-20T15:03:53.741 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2023-07-20T15:03:53.741 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2023-07-20T15:03:53.741 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2023-07-20T15:03:53.741 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2023-07-20T15:03:53.741 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2023-07-20T15:03:53.742 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2023-07-20T15:03:53.742 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2023-07-20T15:03:53.742 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2023-07-20T15:03:53.742 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2023-07-20T15:03:53.742 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2023-07-20T15:03:53.743 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2023-07-20T15:03:53.743 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2023-07-20T15:03:53.744 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2023-07-20T15:03:53.744 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2023-07-20T15:03:53.744 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2023-07-20T15:03:53.744 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2023-07-20T15:03:53.744 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2023-07-20T15:03:53.744 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2023-07-20T15:03:53.744 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2023-07-20T15:03:53.745 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2023-07-20T15:03:53.745 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2023-07-20T15:03:53.745 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2023-07-20T15:03:53.745 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2023-07-20T15:03:53.745 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2023-07-20T15:03:53.745 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2023-07-20T15:03:53.745 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2023-07-20T15:03:53.746 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2023-07-20T15:03:53.746 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2023-07-20T15:03:53.746 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2023-07-20T15:03:53.746 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2023-07-20T15:03:53.746 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2023-07-20T15:03:53.746 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2023-07-20T15:03:53.746 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2023-07-20T15:03:53.747 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2023-07-20T15:03:53.747 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2023-07-20T15:03:53.747 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2023-07-20T15:03:53.747 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2023-07-20T15:03:53.747 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2023-07-20T15:03:53.747 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2023-07-20T15:03:53.747 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2023-07-20T15:03:53.747 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2023-07-20T15:03:53.748 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2023-07-20T15:03:53.749 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2023-07-20T15:03:53.749 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2023-07-20T15:03:53.749 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2023-07-20T15:03:53.749 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2023-07-20T15:03:53.749 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2023-07-20T15:03:53.749 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2023-07-20T15:03:53.749 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2023-07-20T15:03:53.750 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2023-07-20T15:03:53.750 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2023-07-20T15:03:53.750 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2023-07-20T15:03:53.750 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2023-07-20T15:03:53.758 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2023-07-20T15:03:53.758 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2023-07-20T15:03:53.759 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2023-07-20T15:03:53.759 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2023-07-20T15:03:53.759 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2023-07-20T15:03:53.759 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2023-07-20T15:03:53.759 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2023-07-20T15:03:53.759 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2023-07-20T15:03:53.774 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2023-07-20T15:03:53.775 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2023-07-20T15:03:53.775 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2023-07-20T15:03:53.775 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2023-07-20T15:03:53.775 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2023-07-20T15:03:53.775 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2023-07-20T15:03:53.776 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2023-07-20T15:03:53.776 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2023-07-20T15:03:53.776 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2023-07-20T15:03:53.776 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2023-07-20T15:03:53.776 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2023-07-20T15:03:53.776 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2023-07-20T15:03:53.776 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2023-07-20T15:03:53.776 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2023-07-20T15:03:53.780 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2023-07-20T15:03:53.781 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2023-07-20T15:03:53.781 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2023-07-20T15:03:53.781 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2023-07-20T15:03:53.781 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2023-07-20T15:03:53.782 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2023-07-20T15:03:53.782 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2023-07-20T15:03:53.782 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2023-07-20T15:03:53.783 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2023-07-20T15:03:53.783 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2023-07-20T15:03:53.783 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2023-07-20T15:03:53.783 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2023-07-20T15:03:53.784 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2023-07-20T15:03:53.785 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2023-07-20T15:03:53.794 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2023-07-20T15:03:53.794 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2023-07-20T15:03:53.794 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2023-07-20T15:03:53.802 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2023-07-20T15:03:53.804 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2023-07-20T15:03:53.804 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2023-07-20T15:03:53.805 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2023-07-20T15:03:53.805 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2023-07-20T15:03:53.805 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2023-07-20T15:03:53.805 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2023-07-20T15:03:53.806 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2023-07-20T15:03:53.806 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2023-07-20T15:03:53.806 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2023-07-20T15:03:53.806 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2023-07-20T15:03:53.806 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2023-07-20T15:03:53.806 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2023-07-20T15:03:53.806 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2023-07-20T15:03:53.806 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2023-07-20T15:03:53.807 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2023-07-20T15:03:53.807 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2023-07-20T15:03:53.807 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2023-07-20T15:03:53.807 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2023-07-20T15:03:53.807 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2023-07-20T15:03:53.807 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2023-07-20T15:03:53.807 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2023-07-20T15:03:53.808 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2023-07-20T15:03:53.808 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2023-07-20T15:03:53.808 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2023-07-20T15:03:53.815 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2023-07-20T15:03:53.815 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2023-07-20T15:03:53.815 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2023-07-20T15:03:53.815 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2023-07-20T15:03:53.816 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2023-07-20T15:03:53.816 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2023-07-20T15:03:53.816 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2023-07-20T15:03:53.816 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2023-07-20T15:03:53.816 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2023-07-20T15:03:53.816 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2023-07-20T15:03:53.816 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2023-07-20T15:03:53.816 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2023-07-20T15:03:53.817 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2023-07-20T15:03:53.817 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2023-07-20T15:03:53.817 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2023-07-20T15:03:53.817 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing HTTPServer" logger=server 2023-07-20T15:03:53.817 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2023-07-20T15:03:53.817 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing PluginManager" logger=server 2023-07-20T15:03:53.817 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Starting plugin search" logger=plugins 2023-07-20T15:03:53.818 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2023-07-20T15:03:53.818 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2023-07-20T15:03:53.818 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing HooksService" logger=server 2023-07-20T15:03:53.818 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2023-07-20T15:03:53.818 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2023-07-20T15:03:53.818 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing RemoteCache" logger=server 2023-07-20T15:03:53.818 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing QuotaService" logger=server 2023-07-20T15:03:53.818 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing ServerLockService" logger=server 2023-07-20T15:03:53.819 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2023-07-20T15:03:53.819 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing RenderingService" logger=server 2023-07-20T15:03:53.819 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing AlertEngine" logger=server 2023-07-20T15:03:53.820 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2023-07-20T15:03:53.820 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing LoginService" logger=server 2023-07-20T15:03:53.820 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing SearchService" logger=server 2023-07-20T15:03:53.820 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing TracingService" logger=server 2023-07-20T15:03:53.820 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2023-07-20T15:03:53.821 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing CleanUpService" logger=server 2023-07-20T15:03:53.821 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing NotificationService" logger=server 2023-07-20T15:03:53.821 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2023-07-20T15:03:53.821 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2023-07-20T15:03:53.821 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name="Dashboard 1" 2023-07-20T15:03:53.821 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2023-07-20T15:03:53.821 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin." logger=rendering renderer=phantomJS 2023-07-20T15:03:53.828 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="Initializing Stream Manager" 2023-07-20T15:03:53.828 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:03:53 smithi178 bash[116267]: t=2023-07-20T15:03:53+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=127.0.0.1:3000 protocol=https subUrl= socket= 2023-07-20T15:03:53.829 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:53 smithi029 bash[119224]: ts=2023-07-20T15:03:53.740Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003527963s 2023-07-20T15:03:54.948 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:54 smithi029 bash[104935]: cluster 2023-07-20T15:03:53.816549+0000 mgr.y (mgr.14142) 157 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:54.949 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:54 smithi029 bash[108361]: cluster 2023-07-20T15:03:53.816549+0000 mgr.y (mgr.14142) 157 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:55.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:54 smithi178 bash[104918]: cluster 2023-07-20T15:03:53.816549+0000 mgr.y (mgr.14142) 157 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:55.245 INFO:teuthology.orchestra.run.smithi029.stdout:133143986196 2023-07-20T15:03:55.245 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2023-07-20T15:03:56.132 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:55 smithi178 bash[104918]: audit 2023-07-20T15:03:55.017533+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016382\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016479\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016513\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016545\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016574\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016604\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016633\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016662\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a73baa49f5ff\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016691\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:43.347759\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:37.265798\"}}, \"last_daemon_update\": \"2023-07-20T15:03:55.016779\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:03:56.132 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:55 smithi178 bash[104918]: audit 2023-07-20T15:03:55.020553+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016382\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016479\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016513\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016545\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016574\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016604\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016633\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016662\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a73baa49f5ff\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016691\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:43.347759\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:37.265798\"}}, \"last_daemon_update\": \"2023-07-20T15:03:55.016779\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:03:56.132 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:55 smithi178 bash[104918]: audit 2023-07-20T15:03:55.021078+0000 mon.a (mon.0) 715 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:56.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:55 smithi029 bash[104935]: audit 2023-07-20T15:03:55.017533+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016382\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016479\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016513\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016545\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016574\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016604\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016633\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016662\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a73baa49f5ff\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016691\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:43.347759\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:37.265798\"}}, \"last_daemon_update\": \"2023-07-20T15:03:55.016779\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:03:56.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:55 smithi029 bash[104935]: audit 2023-07-20T15:03:55.020553+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016382\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016479\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016513\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016545\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016574\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016604\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016633\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016662\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a73baa49f5ff\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016691\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:43.347759\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:37.265798\"}}, \"last_daemon_update\": \"2023-07-20T15:03:55.016779\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:03:56.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:55 smithi029 bash[104935]: audit 2023-07-20T15:03:55.021078+0000 mon.a (mon.0) 715 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:56.211 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:55 smithi029 bash[108361]: audit 2023-07-20T15:03:55.017533+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016382\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016479\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016513\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016545\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016574\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016604\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016633\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016662\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a73baa49f5ff\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016691\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:43.347759\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:37.265798\"}}, \"last_daemon_update\": \"2023-07-20T15:03:55.016779\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:03:56.212 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:55 smithi029 bash[108361]: audit 2023-07-20T15:03:55.020553+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016382\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016479\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016513\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016545\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016574\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016604\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016633\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016662\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a73baa49f5ff\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016691\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:43.347759\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:37.265798\"}}, \"last_daemon_update\": \"2023-07-20T15:03:55.016779\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:03:56.212 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:55 smithi029 bash[108361]: audit 2023-07-20T15:03:55.021078+0000 mon.a (mon.0) 715 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:03:56.621 INFO:teuthology.orchestra.run.smithi029.stdout:171798691855 2023-07-20T15:03:56.622 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2023-07-20T15:03:57.145 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:56 smithi178 bash[104918]: cluster 2023-07-20T15:03:55.816830+0000 mgr.y (mgr.14142) 158 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:57.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:56 smithi029 bash[104935]: cluster 2023-07-20T15:03:55.816830+0000 mgr.y (mgr.14142) 158 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:57.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:56 smithi029 bash[108361]: cluster 2023-07-20T15:03:55.816830+0000 mgr.y (mgr.14142) 158 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:58.152 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:57 smithi029 bash[104935]: audit 2023-07-20T15:03:57.088186+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087021\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087097\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087131\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087161\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087191\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087221\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087261\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087291\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087320\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:03:57.087405\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:58.153 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:57 smithi029 bash[104935]: audit 2023-07-20T15:03:57.090877+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087021\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087097\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087131\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087161\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087191\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087221\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087261\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087291\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087320\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:03:57.087405\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:58.153 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:57 smithi029 bash[104935]: cephadm 2023-07-20T15:03:57.093088+0000 mgr.y (mgr.14142) 159 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2023-07-20T15:03:58.153 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:57 smithi029 bash[104935]: cephadm 2023-07-20T15:03:57.094961+0000 mgr.y (mgr.14142) 160 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi029 2023-07-20T15:03:58.154 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:57 smithi029 bash[104935]: cluster 2023-07-20T15:03:57.817257+0000 mgr.y (mgr.14142) 161 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:58.154 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:57 smithi029 bash[108361]: audit 2023-07-20T15:03:57.088186+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087021\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087097\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087131\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087161\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087191\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087221\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087261\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087291\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087320\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:03:57.087405\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:58.154 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:57 smithi029 bash[108361]: audit 2023-07-20T15:03:57.090877+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087021\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087097\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087131\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087161\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087191\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087221\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087261\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087291\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087320\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:03:57.087405\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:58.154 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:57 smithi029 bash[108361]: cephadm 2023-07-20T15:03:57.093088+0000 mgr.y (mgr.14142) 159 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2023-07-20T15:03:58.155 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:57 smithi029 bash[108361]: cephadm 2023-07-20T15:03:57.094961+0000 mgr.y (mgr.14142) 160 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi029 2023-07-20T15:03:58.155 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:57 smithi029 bash[108361]: cluster 2023-07-20T15:03:57.817257+0000 mgr.y (mgr.14142) 161 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:58.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:57 smithi178 bash[104918]: audit 2023-07-20T15:03:57.088186+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087021\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087097\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087131\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087161\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087191\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087221\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087261\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087291\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087320\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:03:57.087405\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:03:58.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:57 smithi178 bash[104918]: audit 2023-07-20T15:03:57.090877+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087021\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087097\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087131\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087161\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087191\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087221\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"ce4197c3c0ca\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087261\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:03:34.730597\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087291\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087320\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:03:26.688432\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:03:57.087405\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:03:58.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:57 smithi178 bash[104918]: cephadm 2023-07-20T15:03:57.093088+0000 mgr.y (mgr.14142) 159 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2023-07-20T15:03:58.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:57 smithi178 bash[104918]: cephadm 2023-07-20T15:03:57.094961+0000 mgr.y (mgr.14142) 160 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi029 2023-07-20T15:03:58.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:57 smithi178 bash[104918]: cluster 2023-07-20T15:03:57.817257+0000 mgr.y (mgr.14142) 161 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:03:58.342 INFO:teuthology.orchestra.run.smithi029.stdout:206158430220 2023-07-20T15:03:58.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2023-07-20T15:03:59.347 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:59 smithi029 systemd[1]: Stopping Ceph alertmanager.a for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:03:59.620 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:59 smithi029 bash[119224]: ts=2023-07-20T15:03:59.371Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2023-07-20T15:03:59.621 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:59 smithi029 podman[121499]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-alertmanager.a 2023-07-20T15:03:59.937 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:59 smithi029 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@alertmanager.a.service: Succeeded. 2023-07-20T15:03:59.937 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:59 smithi029 systemd[1]: Stopped Ceph alertmanager.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:03:59.937 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:59 smithi029 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@alertmanager.a.service: Found left-over process 119260 (conmon) in control group while starting unit. Ignoring. 2023-07-20T15:03:59.938 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:59 smithi029 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2023-07-20T15:03:59.938 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:59 smithi029 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@alertmanager.a.service: Found left-over process 121537 (podman) in control group while starting unit. Ignoring. 2023-07-20T15:03:59.938 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:59 smithi029 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2023-07-20T15:03:59.938 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:59 smithi029 systemd[1]: Starting Ceph alertmanager.a for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:03:59.938 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:59 smithi029 podman[121586]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-alertmanager.a" found: no such container 2023-07-20T15:03:59.938 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:03:59 smithi029 systemd[1]: Started Ceph alertmanager.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:03:59.939 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:59 smithi029 bash[104935]: audit 2023-07-20T15:03:59.703155+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016382\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016479\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016513\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016545\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016574\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016604\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016633\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016662\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:03:59.939 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:03:59 smithi029 bash[104935]: audit 2023-07-20T15:03:59.706306+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016382\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016479\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016513\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016545\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016574\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016604\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016633\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016662\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:03:59.939 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:59 smithi029 bash[108361]: audit 2023-07-20T15:03:59.703155+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016382\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016479\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016513\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016545\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016574\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016604\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016633\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016662\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:03:59.940 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:03:59 smithi029 bash[108361]: audit 2023-07-20T15:03:59.706306+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016382\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016479\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016513\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016545\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016574\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016604\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016633\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016662\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:04:00.050 INFO:teuthology.orchestra.run.smithi029.stdout:244813135882 2023-07-20T15:04:00.051 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2023-07-20T15:04:00.177 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:59 smithi178 bash[104918]: audit 2023-07-20T15:03:59.703155+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016382\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016479\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016513\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016545\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016574\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016604\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016633\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016662\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:04:00.177 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:03:59 smithi178 bash[104918]: audit 2023-07-20T15:03:59.706306+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016382\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016479\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016513\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016545\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016574\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016604\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016633\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:55.016662\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:04:00.545 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:04:00 smithi029 bash[121612]: ts=2023-07-20T15:04:00.234Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2023-07-20T15:04:00.545 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:04:00 smithi029 bash[121612]: ts=2023-07-20T15:04:00.234Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2023-07-20T15:04:00.545 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:04:00 smithi029 bash[121612]: ts=2023-07-20T15:04:00.234Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.29 port=9094 2023-07-20T15:04:00.545 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:04:00 smithi029 bash[121612]: ts=2023-07-20T15:04:00.235Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2023-07-20T15:04:00.545 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:04:00 smithi029 bash[121612]: ts=2023-07-20T15:04:00.259Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2023-07-20T15:04:00.546 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:04:00 smithi029 bash[121612]: ts=2023-07-20T15:04:00.260Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2023-07-20T15:04:00.546 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:04:00 smithi029 bash[121612]: ts=2023-07-20T15:04:00.263Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2023-07-20T15:04:00.546 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:04:00 smithi029 bash[121612]: ts=2023-07-20T15:04:00.263Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2023-07-20T15:04:01.151 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:00 smithi178 bash[104918]: cephadm 2023-07-20T15:03:59.706848+0000 mgr.y (mgr.14142) 162 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2023-07-20T15:04:01.151 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:00 smithi178 bash[104918]: cephadm 2023-07-20T15:03:59.708811+0000 mgr.y (mgr.14142) 163 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi178 2023-07-20T15:04:01.152 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:00 smithi178 bash[104918]: cluster 2023-07-20T15:03:59.817564+0000 mgr.y (mgr.14142) 164 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:01.163 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:00 smithi029 bash[104935]: cephadm 2023-07-20T15:03:59.706848+0000 mgr.y (mgr.14142) 162 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2023-07-20T15:04:01.164 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:00 smithi029 bash[104935]: cephadm 2023-07-20T15:03:59.708811+0000 mgr.y (mgr.14142) 163 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi178 2023-07-20T15:04:01.164 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:00 smithi029 bash[104935]: cluster 2023-07-20T15:03:59.817564+0000 mgr.y (mgr.14142) 164 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:01.164 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:00 smithi029 bash[108361]: cephadm 2023-07-20T15:03:59.706848+0000 mgr.y (mgr.14142) 162 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2023-07-20T15:04:01.164 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:00 smithi029 bash[108361]: cephadm 2023-07-20T15:03:59.708811+0000 mgr.y (mgr.14142) 163 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi178 2023-07-20T15:04:01.164 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:00 smithi029 bash[108361]: cluster 2023-07-20T15:03:59.817564+0000 mgr.y (mgr.14142) 164 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:01.489 INFO:teuthology.orchestra.run.smithi029.stdout:257698037770 2023-07-20T15:04:01.489 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.0 2023-07-20T15:04:01.669 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:01 smithi178 systemd[1]: Stopping Ceph prometheus.a for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:04:01.983 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:01 smithi178 bash[115318]: ts=2023-07-20T15:04:01.660Z caller=main.go:854 level=warn msg="Received SIGTERM, exiting gracefully..." 2023-07-20T15:04:01.983 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:01 smithi178 bash[115318]: ts=2023-07-20T15:04:01.661Z caller=main.go:878 level=info msg="Stopping scrape discovery manager..." 2023-07-20T15:04:01.983 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:01 smithi178 bash[115318]: ts=2023-07-20T15:04:01.661Z caller=main.go:892 level=info msg="Stopping notify discovery manager..." 2023-07-20T15:04:01.983 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:01 smithi178 bash[115318]: ts=2023-07-20T15:04:01.661Z caller=manager.go:1009 level=info component="rule manager" msg="Stopping rule manager..." 2023-07-20T15:04:01.983 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:01 smithi178 bash[115318]: ts=2023-07-20T15:04:01.661Z caller=manager.go:1019 level=info component="rule manager" msg="Rule manager stopped" 2023-07-20T15:04:01.983 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:01 smithi178 bash[115318]: ts=2023-07-20T15:04:01.661Z caller=main.go:929 level=info msg="Stopping scrape manager..." 2023-07-20T15:04:01.984 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:01 smithi178 bash[115318]: ts=2023-07-20T15:04:01.661Z caller=main.go:888 level=info msg="Notify discovery manager stopped" 2023-07-20T15:04:01.984 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:01 smithi178 bash[115318]: ts=2023-07-20T15:04:01.661Z caller=main.go:874 level=info msg="Scrape discovery manager stopped" 2023-07-20T15:04:01.984 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:01 smithi178 bash[115318]: ts=2023-07-20T15:04:01.661Z caller=main.go:921 level=info msg="Scrape manager stopped" 2023-07-20T15:04:01.984 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:01 smithi178 bash[115318]: ts=2023-07-20T15:04:01.661Z caller=notifier.go:603 level=info component=notifier msg="Stopping notification manager..." 2023-07-20T15:04:01.984 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:01 smithi178 bash[115318]: ts=2023-07-20T15:04:01.661Z caller=main.go:1150 level=info msg="Notifier manager stopped" 2023-07-20T15:04:01.984 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:01 smithi178 bash[115318]: ts=2023-07-20T15:04:01.661Z caller=main.go:1162 level=info msg="See you next time!" 2023-07-20T15:04:02.422 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:01 smithi178 podman[116896]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-prometheus.a 2023-07-20T15:04:02.423 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@prometheus.a.service: Succeeded. 2023-07-20T15:04:02.424 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 systemd[1]: Stopped Ceph prometheus.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:04:02.424 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 systemd[1]: Starting Ceph prometheus.a for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:04:02.424 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 podman[116937]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-prometheus.a" found: no such container 2023-07-20T15:04:02.424 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 systemd[1]: Started Ceph prometheus.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:04:02.635 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:04:02 smithi029 bash[121612]: ts=2023-07-20T15:04:02.236Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000647005s 2023-07-20T15:04:02.780 INFO:teuthology.orchestra.run.smithi029.stdout:60129542171 2023-07-20T15:04:02.869 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.619Z caller=main.go:534 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2023-07-20T15:04:02.870 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.619Z caller=main.go:578 level=info msg="Starting Prometheus Server" mode=server version="(version=2.45.0, branch=HEAD, revision=8ef767e396bf8445f009f945b0162fd71827f445)" 2023-07-20T15:04:02.870 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.619Z caller=main.go:583 level=info build_context="(go=go1.20.5, platform=linux/amd64, user=root@920118f645b7, date=20230623-15:09:49, tags=netgo,builtinassets,stringlabels)" 2023-07-20T15:04:02.870 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.619Z caller=main.go:584 level=info host_details="(Linux 4.18.0-500.el8.x86_64 #1 SMP Wed Jun 28 00:07:07 UTC 2023 x86_64 smithi178 (none))" 2023-07-20T15:04:02.870 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.619Z caller=main.go:585 level=info fd_limits="(soft=1048576, hard=1048576)" 2023-07-20T15:04:02.870 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.619Z caller=main.go:586 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2023-07-20T15:04:02.871 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.621Z caller=web.go:562 level=info component=web msg="Start listening for connections" address=:9095 2023-07-20T15:04:02.871 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.621Z caller=main.go:1019 level=info msg="Starting TSDB ..." 2023-07-20T15:04:02.871 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.622Z caller=tls_config.go:274 level=info component=web msg="Listening on" address=[::]:9095 2023-07-20T15:04:02.871 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.622Z caller=tls_config.go:277 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2023-07-20T15:04:02.871 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.624Z caller=head.go:595 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2023-07-20T15:04:02.871 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.624Z caller=head.go:676 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.314µs 2023-07-20T15:04:02.871 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.624Z caller=head.go:684 level=info component=tsdb msg="Replaying WAL, this may take a while" 2023-07-20T15:04:02.871 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.625Z caller=head.go:755 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2023-07-20T15:04:02.872 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.625Z caller=head.go:755 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2023-07-20T15:04:02.872 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.625Z caller=head.go:792 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=41.876µs wal_replay_duration=553.432µs wbl_replay_duration=150ns total_replay_duration=622.581µs 2023-07-20T15:04:02.874 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.625Z caller=main.go:1040 level=info fs_type=XFS_SUPER_MAGIC 2023-07-20T15:04:02.874 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.625Z caller=main.go:1043 level=info msg="TSDB started" 2023-07-20T15:04:02.874 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.626Z caller=main.go:1224 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2023-07-20T15:04:02.874 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.626Z caller=main.go:1261 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=707.429µs db_storage=727ns remote_storage=1.451µs web_handler=281ns query_engine=641ns scrape=363.366µs scrape_sd=25.116µs notify=18.796µs notify_sd=5.64µs rules=25.601µs tracing=4.772µs 2023-07-20T15:04:02.880 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.626Z caller=main.go:1004 level=info msg="Server is ready to receive web requests." 2023-07-20T15:04:02.881 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[116954]: ts=2023-07-20T15:04:02.626Z caller=manager.go:995 level=info component="rule manager" msg="Starting rule manager..." 2023-07-20T15:04:02.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:02 smithi029 bash[104935]: cluster 2023-07-20T15:04:01.817853+0000 mgr.y (mgr.14142) 165 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:02.949 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:02 smithi029 bash[108361]: cluster 2023-07-20T15:04:01.817853+0000 mgr.y (mgr.14142) 165 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:02.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:02 smithi029 bash[104935]: audit 2023-07-20T15:04:02.170080+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087021\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087097\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087131\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087161\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087191\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087221\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087291\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087320\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:04:02.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:02 smithi029 bash[104935]: audit 2023-07-20T15:04:02.172647+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087021\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087097\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087131\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087161\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087191\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087221\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087291\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087320\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:04:02.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:02 smithi029 bash[104935]: audit 2023-07-20T15:04:02.173203+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi178:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2023-07-20T15:04:02.951 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:02 smithi029 bash[108361]: audit 2023-07-20T15:04:02.170080+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087021\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087097\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087131\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087161\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087191\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087221\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087291\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087320\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:04:02.951 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:02 smithi029 bash[108361]: audit 2023-07-20T15:04:02.172647+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087021\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087097\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087131\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087161\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087191\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087221\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087291\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087320\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:04:02.951 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:02 smithi029 bash[108361]: audit 2023-07-20T15:04:02.173203+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi178:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2023-07-20T15:04:02.952 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:02 smithi029 bash[104935]: audit 2023-07-20T15:04:02.175967+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi178:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2023-07-20T15:04:02.952 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:02 smithi029 bash[104935]: audit 2023-07-20T15:04:02.178122+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:02.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:02 smithi029 bash[104935]: audit 2023-07-20T15:04:02.735464+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.29:0/1006845643' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-07-20T15:04:02.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:02 smithi029 bash[108361]: audit 2023-07-20T15:04:02.175967+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi178:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2023-07-20T15:04:02.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:02 smithi029 bash[108361]: audit 2023-07-20T15:04:02.178122+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:02.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:02 smithi029 bash[108361]: audit 2023-07-20T15:04:02.735464+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.29:0/1006845643' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-07-20T15:04:03.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[104918]: cluster 2023-07-20T15:04:01.817853+0000 mgr.y (mgr.14142) 165 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:03.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[104918]: audit 2023-07-20T15:04:02.170080+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087021\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087097\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087131\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087161\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087191\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087221\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087291\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087320\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:04:03.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[104918]: audit 2023-07-20T15:04:02.172647+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087021\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087097\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087131\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087161\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087191\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087221\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087291\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:03:57.087320\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:04:03.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[104918]: audit 2023-07-20T15:04:02.173203+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi178:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2023-07-20T15:04:03.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[104918]: audit 2023-07-20T15:04:02.175967+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi178:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2023-07-20T15:04:03.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[104918]: audit 2023-07-20T15:04:02.178122+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:03.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:02 smithi178 bash[104918]: audit 2023-07-20T15:04:02.735464+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.29:0/1006845643' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-07-20T15:04:03.261 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542169 got 60129542171 for osd.0 2023-07-20T15:04:03.261 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.1 2023-07-20T15:04:03.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:03 smithi029 bash[104935]: cephadm 2023-07-20T15:04:02.173051+0000 mgr.y (mgr.14142) 166 : cephadm [INF] Setting dashboard grafana config to https://smithi178:3000 2023-07-20T15:04:03.949 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:03 smithi029 bash[108361]: cephadm 2023-07-20T15:04:02.173051+0000 mgr.y (mgr.14142) 166 : cephadm [INF] Setting dashboard grafana config to https://smithi178:3000 2023-07-20T15:04:04.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:03 smithi178 bash[104918]: cephadm 2023-07-20T15:04:02.173051+0000 mgr.y (mgr.14142) 166 : cephadm [INF] Setting dashboard grafana config to https://smithi178:3000 2023-07-20T15:04:04.606 INFO:teuthology.orchestra.run.smithi029.stdout:85899345945 2023-07-20T15:04:04.889 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:04 smithi029 bash[104935]: cluster 2023-07-20T15:04:03.818284+0000 mgr.y (mgr.14142) 167 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:04.890 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:04 smithi029 bash[108361]: cluster 2023-07-20T15:04:03.818284+0000 mgr.y (mgr.14142) 167 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:04.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:04 smithi029 bash[104935]: audit 2023-07-20T15:04:04.391094+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389810\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389886\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389920\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389951\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389980\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390010\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390038\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390067\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390096\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_daemon_update\": \"2023-07-20T15:04:04.390170\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:04:04.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:04 smithi029 bash[104935]: audit 2023-07-20T15:04:04.393850+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389810\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389886\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389920\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389951\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389980\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390010\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390038\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390067\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390096\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_daemon_update\": \"2023-07-20T15:04:04.390170\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:04:04.892 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:04 smithi029 bash[104935]: audit 2023-07-20T15:04:04.394441+0000 mon.a (mon.0) 727 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:04.892 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:04 smithi029 bash[104935]: audit 2023-07-20T15:04:04.560343+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.15.29:0/2077762480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-07-20T15:04:04.892 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:04 smithi029 bash[108361]: audit 2023-07-20T15:04:04.391094+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389810\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389886\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389920\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389951\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389980\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390010\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390038\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390067\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390096\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_daemon_update\": \"2023-07-20T15:04:04.390170\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:04:04.893 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:04 smithi029 bash[108361]: audit 2023-07-20T15:04:04.393850+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389810\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389886\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389920\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389951\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389980\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390010\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390038\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390067\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390096\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_daemon_update\": \"2023-07-20T15:04:04.390170\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:04:04.893 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:04 smithi029 bash[108361]: audit 2023-07-20T15:04:04.394441+0000 mon.a (mon.0) 727 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:04.893 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:04 smithi029 bash[108361]: audit 2023-07-20T15:04:04.560343+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.15.29:0/2077762480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-07-20T15:04:04.975 INFO:tasks.cephadm.ceph_manager.ceph:need seq 85899345942 got 85899345945 for osd.1 2023-07-20T15:04:04.976 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.2 2023-07-20T15:04:05.081 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:04 smithi178 bash[104918]: cluster 2023-07-20T15:04:03.818284+0000 mgr.y (mgr.14142) 167 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:05.081 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:04 smithi178 bash[104918]: audit 2023-07-20T15:04:04.391094+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389810\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389886\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389920\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389951\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389980\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390010\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390038\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390067\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390096\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_daemon_update\": \"2023-07-20T15:04:04.390170\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:04:05.082 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:04 smithi178 bash[104918]: audit 2023-07-20T15:04:04.393850+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389810\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389886\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389920\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389951\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.389980\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390010\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390038\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390067\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:04.390096\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_daemon_update\": \"2023-07-20T15:04:04.390170\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:04:05.082 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:04 smithi178 bash[104918]: audit 2023-07-20T15:04:04.394441+0000 mon.a (mon.0) 727 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:05.082 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:04 smithi178 bash[104918]: audit 2023-07-20T15:04:04.560343+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.15.29:0/2077762480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-07-20T15:04:06.091 INFO:teuthology.orchestra.run.smithi029.stdout:115964117014 2023-07-20T15:04:06.433 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117011 got 115964117014 for osd.2 2023-07-20T15:04:06.433 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.3 2023-07-20T15:04:07.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:06 smithi178 bash[104918]: cluster 2023-07-20T15:04:05.818612+0000 mgr.y (mgr.14142) 168 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:07.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:06 smithi178 bash[104918]: audit 2023-07-20T15:04:06.044080+0000 mon.a (mon.0) 728 : audit [DBG] from='client.? 172.21.15.29:0/632071875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-07-20T15:04:07.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:06 smithi178 bash[104918]: audit 2023-07-20T15:04:06.503197+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502066\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502142\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502177\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502208\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502245\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502279\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502309\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502339\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502369\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:04:06.502444\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:04:07.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:06 smithi178 bash[104918]: audit 2023-07-20T15:04:06.506621+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502066\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502142\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502177\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502208\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502245\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502279\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502309\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502339\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502369\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:04:06.502444\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:04:07.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:06 smithi178 bash[104918]: audit 2023-07-20T15:04:06.508593+0000 mon.a (mon.0) 731 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:07.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:06 smithi029 bash[104935]: cluster 2023-07-20T15:04:05.818612+0000 mgr.y (mgr.14142) 168 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:07.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:06 smithi029 bash[104935]: audit 2023-07-20T15:04:06.044080+0000 mon.a (mon.0) 728 : audit [DBG] from='client.? 172.21.15.29:0/632071875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-07-20T15:04:07.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:06 smithi029 bash[104935]: audit 2023-07-20T15:04:06.503197+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502066\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502142\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502177\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502208\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502245\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502279\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502309\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502339\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502369\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:04:06.502444\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:04:07.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:06 smithi029 bash[104935]: audit 2023-07-20T15:04:06.506621+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502066\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502142\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502177\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502208\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502245\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502279\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502309\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502339\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502369\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:04:06.502444\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:04:07.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:06 smithi029 bash[104935]: audit 2023-07-20T15:04:06.508593+0000 mon.a (mon.0) 731 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:07.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:06 smithi029 bash[108361]: cluster 2023-07-20T15:04:05.818612+0000 mgr.y (mgr.14142) 168 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:07.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:06 smithi029 bash[108361]: audit 2023-07-20T15:04:06.044080+0000 mon.a (mon.0) 728 : audit [DBG] from='client.? 172.21.15.29:0/632071875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-07-20T15:04:07.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:06 smithi029 bash[108361]: audit 2023-07-20T15:04:06.503197+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502066\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502142\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502177\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502208\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502245\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502279\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502309\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502339\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502369\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:04:06.502444\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:04:07.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:06 smithi029 bash[108361]: audit 2023-07-20T15:04:06.506621+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502066\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502142\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502177\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502208\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502245\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502279\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502309\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502339\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:06.502369\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:04:06.502444\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:04:07.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:06 smithi029 bash[108361]: audit 2023-07-20T15:04:06.508593+0000 mon.a (mon.0) 731 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:07.851 INFO:teuthology.orchestra.run.smithi029.stdout:133143986198 2023-07-20T15:04:08.168 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:07 smithi029 bash[104935]: audit 2023-07-20T15:04:07.805727+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.15.29:0/1621719412' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-07-20T15:04:08.168 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:07 smithi029 bash[108361]: audit 2023-07-20T15:04:07.805727+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.15.29:0/1621719412' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-07-20T15:04:08.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:07 smithi178 bash[104918]: audit 2023-07-20T15:04:07.805727+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.15.29:0/1621719412' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-07-20T15:04:08.266 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986196 got 133143986198 for osd.3 2023-07-20T15:04:08.267 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.4 2023-07-20T15:04:08.889 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:08 smithi029 bash[108361]: cluster 2023-07-20T15:04:07.819106+0000 mgr.y (mgr.14142) 169 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:08.889 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:08 smithi029 bash[108361]: audit 2023-07-20T15:04:08.589515+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588413\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588488\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588523\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588554\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588584\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588614\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588644\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588674\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588704\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_daemon_update\": \"2023-07-20T15:04:08.588779\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:04:08.890 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:08 smithi029 bash[108361]: audit 2023-07-20T15:04:08.593117+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588413\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588488\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588523\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588554\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588584\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588614\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588644\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588674\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588704\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_daemon_update\": \"2023-07-20T15:04:08.588779\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:04:08.890 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:08 smithi029 bash[108361]: audit 2023-07-20T15:04:08.593689+0000 mon.a (mon.0) 734 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:09.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:08 smithi178 bash[104918]: cluster 2023-07-20T15:04:07.819106+0000 mgr.y (mgr.14142) 169 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:09.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:08 smithi178 bash[104918]: audit 2023-07-20T15:04:08.589515+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588413\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588488\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588523\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588554\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588584\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588614\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588644\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588674\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588704\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_daemon_update\": \"2023-07-20T15:04:08.588779\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:04:09.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:08 smithi178 bash[104918]: audit 2023-07-20T15:04:08.593117+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588413\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588488\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588523\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588554\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588584\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588614\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588644\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588674\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588704\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_daemon_update\": \"2023-07-20T15:04:08.588779\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:04:09.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:08 smithi178 bash[104918]: audit 2023-07-20T15:04:08.593689+0000 mon.a (mon.0) 734 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:09.178 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:08 smithi029 bash[104935]: cluster 2023-07-20T15:04:07.819106+0000 mgr.y (mgr.14142) 169 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:09.178 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:08 smithi029 bash[104935]: audit 2023-07-20T15:04:08.589515+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588413\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588488\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588523\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588554\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588584\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588614\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588644\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588674\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588704\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_daemon_update\": \"2023-07-20T15:04:08.588779\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:04:09.178 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:08 smithi029 bash[104935]: audit 2023-07-20T15:04:08.593117+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588413\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588488\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588523\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588554\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588584\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588614\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588644\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588674\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588704\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}}, \"last_daemon_update\": \"2023-07-20T15:04:08.588779\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:04:09.178 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:08 smithi029 bash[104935]: audit 2023-07-20T15:04:08.593689+0000 mon.a (mon.0) 734 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:09.504 INFO:teuthology.orchestra.run.smithi029.stdout:171798691857 2023-07-20T15:04:09.867 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691855 got 171798691857 for osd.4 2023-07-20T15:04:09.867 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.5 2023-07-20T15:04:09.919 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:09 smithi178 bash[104918]: audit 2023-07-20T15:04:09.453824+0000 mon.a (mon.0) 735 : audit [DBG] from='client.? 172.21.15.29:0/3364230813' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-07-20T15:04:10.132 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:09 smithi029 bash[104935]: audit 2023-07-20T15:04:09.453824+0000 mon.a (mon.0) 735 : audit [DBG] from='client.? 172.21.15.29:0/3364230813' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-07-20T15:04:10.132 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:09 smithi029 bash[108361]: audit 2023-07-20T15:04:09.453824+0000 mon.a (mon.0) 735 : audit [DBG] from='client.? 172.21.15.29:0/3364230813' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-07-20T15:04:10.409 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:04:10 smithi029 bash[121612]: ts=2023-07-20T15:04:10.238Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002933135s 2023-07-20T15:04:10.920 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:10 smithi178 bash[104918]: cluster 2023-07-20T15:04:09.819465+0000 mgr.y (mgr.14142) 170 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:10.920 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:10 smithi178 bash[104918]: audit 2023-07-20T15:04:10.568963+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567703\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567778\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567812\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567843\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567872\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567901\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567932\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567961\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567990\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:04:10.568067\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:04:10.921 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:10 smithi178 bash[104918]: audit 2023-07-20T15:04:10.572926+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567703\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567778\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567812\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567843\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567872\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567901\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567932\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567961\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567990\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:04:10.568067\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:04:10.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:10 smithi029 bash[104935]: cluster 2023-07-20T15:04:09.819465+0000 mgr.y (mgr.14142) 170 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:10.950 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:10 smithi029 bash[108361]: cluster 2023-07-20T15:04:09.819465+0000 mgr.y (mgr.14142) 170 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:10.950 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:10 smithi029 bash[108361]: audit 2023-07-20T15:04:10.568963+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567703\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567778\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567812\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567843\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567872\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567901\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567932\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567961\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567990\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:04:10.568067\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:04:10.950 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:10 smithi029 bash[108361]: audit 2023-07-20T15:04:10.572926+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567703\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567778\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567812\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567843\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567872\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567901\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567932\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567961\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567990\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:04:10.568067\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:04:10.951 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:10 smithi029 bash[104935]: audit 2023-07-20T15:04:10.568963+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567703\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567778\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567812\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567843\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567872\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567901\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567932\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567961\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567990\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:04:10.568067\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:04:10.951 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:10 smithi029 bash[104935]: audit 2023-07-20T15:04:10.572926+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567703\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567778\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567812\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567843\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567872\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567901\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567932\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567961\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567990\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}}, \"last_daemon_update\": \"2023-07-20T15:04:10.568067\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:04:11.023 INFO:teuthology.orchestra.run.smithi029.stdout:206158430223 2023-07-20T15:04:11.338 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430220 got 206158430223 for osd.5 2023-07-20T15:04:11.339 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.6 2023-07-20T15:04:12.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:11 smithi178 bash[104918]: audit 2023-07-20T15:04:10.978100+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.15.29:0/155648149' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-07-20T15:04:12.199 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:11 smithi029 bash[108361]: audit 2023-07-20T15:04:10.978100+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.15.29:0/155648149' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-07-20T15:04:12.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:11 smithi029 bash[104935]: audit 2023-07-20T15:04:10.978100+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.15.29:0/155648149' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-07-20T15:04:13.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:12 smithi178 bash[104918]: cluster 2023-07-20T15:04:11.819769+0000 mgr.y (mgr.14142) 171 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:13.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:12 smithi029 bash[104935]: cluster 2023-07-20T15:04:11.819769+0000 mgr.y (mgr.14142) 171 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:13.199 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:12 smithi029 bash[108361]: cluster 2023-07-20T15:04:11.819769+0000 mgr.y (mgr.14142) 171 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:13.844 INFO:teuthology.orchestra.run.smithi029.stdout:244813135884 2023-07-20T15:04:14.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:13 smithi178 bash[104918]: audit 2023-07-20T15:04:13.799815+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.15.29:0/1499129481' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-07-20T15:04:14.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:13 smithi178 bash[104918]: cluster 2023-07-20T15:04:13.820070+0000 mgr.y (mgr.14142) 172 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:14.189 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:13 smithi029 bash[104935]: audit 2023-07-20T15:04:13.799815+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.15.29:0/1499129481' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-07-20T15:04:14.189 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:13 smithi029 bash[104935]: cluster 2023-07-20T15:04:13.820070+0000 mgr.y (mgr.14142) 172 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:14.190 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:13 smithi029 bash[108361]: audit 2023-07-20T15:04:13.799815+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.15.29:0/1499129481' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-07-20T15:04:14.190 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:13 smithi029 bash[108361]: cluster 2023-07-20T15:04:13.820070+0000 mgr.y (mgr.14142) 172 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:14.259 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135882 got 244813135884 for osd.6 2023-07-20T15:04:14.259 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.7 2023-07-20T15:04:15.440 INFO:teuthology.orchestra.run.smithi029.stdout:257698037773 2023-07-20T15:04:15.805 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037770 got 257698037773 for osd.7 2023-07-20T15:04:15.806 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-07-20T15:04:15.806 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph pg dump --format=json 2023-07-20T15:04:16.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:15 smithi178 bash[104918]: audit 2023-07-20T15:04:15.395273+0000 mon.c (mon.1) 32 : audit [DBG] from='client.? 172.21.15.29:0/166082890' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-07-20T15:04:16.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:15 smithi029 bash[104935]: audit 2023-07-20T15:04:15.395273+0000 mon.c (mon.1) 32 : audit [DBG] from='client.? 172.21.15.29:0/166082890' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-07-20T15:04:16.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:15 smithi029 bash[108361]: audit 2023-07-20T15:04:15.395273+0000 mon.c (mon.1) 32 : audit [DBG] from='client.? 172.21.15.29:0/166082890' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-07-20T15:04:16.970 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T15:04:16.973 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-07-20T15:04:17.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:16 smithi178 bash[104918]: cluster 2023-07-20T15:04:15.820392+0000 mgr.y (mgr.14142) 173 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:17.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:16 smithi029 bash[104935]: cluster 2023-07-20T15:04:15.820392+0000 mgr.y (mgr.14142) 173 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:17.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:16 smithi029 bash[108361]: cluster 2023-07-20T15:04:15.820392+0000 mgr.y (mgr.14142) 173 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:17.324 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2023-07-20T15:04:15.820214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":8393428,"kb_used_data":4756,"kb_used_omap":42,"kb_used_meta":8388565,"kb_avail":741567788,"statfs":{"total":767960285184,"available":759365414912,"internally_reserved":8589934592,"allocated":4870144,"data_stored":1944078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43599,"internal_metadata":8589890993},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002165"},"pg_stats":[{"pgid":"1.0","version":"21'1","reported_seq":"14","reported_epoch":"61","state":"active+clean","last_fresh":"2023-07-20T15:03:23.950036+0000","last_change":"2023-07-20T15:03:23.950036+0000","last_active":"2023-07-20T15:03:23.950036+0000","last_peered":"2023-07-20T15:03:23.950036+0000","last_clean":"2023-07-20T15:03:23.950036+0000","last_became_active":"2023-07-20T15:03:23.947582+0000","last_became_peered":"2023-07-20T15:03:23.947582+0000","last_unstale":"2023-07-20T15:03:23.950036+0000","last_undegraded":"2023-07-20T15:03:23.950036+0000","last_fullsized":"2023-07-20T15:03:23.950036+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T14:59:50.222895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T14:59:50.222895+0000","last_clean_scrub_stamp":"2023-07-20T14:59:50.222895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33482,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":60,"seq":257698037773,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049180,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695972,"statfs":{"total":95995035648,"available":94920675328,"internally_reserved":1073741824,"allocated":610304,"data_stored":243120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":6,"up_from":57,"seq":244813135885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049180,"kb_used_data":596,"kb_used_omap":7,"kb_used_meta":1048568,"kb_avail":92695972,"statfs":{"total":95995035648,"available":94920675328,"internally_reserved":1073741824,"allocated":610304,"data_stored":243120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7608,"internal_metadata":1073734216},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]},{"osd":1,"up_from":20,"seq":85899345947,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049180,"kb_used_data":596,"kb_used_omap":4,"kb_used_meta":1048571,"kb_avail":92695972,"statfs":{"total":95995035648,"available":94920675328,"internally_reserved":1073741824,"allocated":610304,"data_stored":243120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4994,"internal_metadata":1073736830},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 15:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.35099999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.51800000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.38,"15min":0.38400000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52000000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.20100000000000001}]},{"osd":2,"last update":"Thu Jul 20 15:03:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.312},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jul 20 15:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.249},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.28199999999999997}]},{"osd":4,"last update":"Thu Jul 20 15:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.38800000000000001}]},{"osd":5,"last update":"Thu Jul 20 15:04:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.37}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542174,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049180,"kb_used_data":596,"kb_used_omap":5,"kb_used_meta":1048570,"kb_avail":92695972,"statfs":{"total":95995035648,"available":94920675328,"internally_reserved":1073741824,"allocated":610304,"data_stored":243120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5123,"internal_metadata":1073736701},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 15:04:13 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.48299999999999998,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.36699999999999999,"15min":0.36899999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jul 20 15:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.433}]},{"osd":3,"last update":"Thu Jul 20 15:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.375}]},{"osd":4,"last update":"Thu Jul 20 15:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.497}]},{"osd":5,"last update":"Thu Jul 20 15:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":2,"up_from":27,"seq":115964117016,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049176,"kb_used_data":592,"kb_used_omap":8,"kb_used_meta":1048567,"kb_avail":92695976,"statfs":{"total":95995035648,"available":94920679424,"internally_reserved":1073741824,"allocated":606208,"data_stored":242826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8886,"internal_metadata":1073732938},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 15:03:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jul 20 15:03:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jul 20 15:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jul 20 15:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jul 20 15:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":3,"up_from":31,"seq":133143986200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049176,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695976,"statfs":{"total":95995035648,"available":94920679424,"internally_reserved":1073741824,"allocated":606208,"data_stored":242826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 15:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.249},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.372}]},{"osd":1,"last update":"Thu Jul 20 15:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jul 20 15:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jul 20 15:03:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.435}]},{"osd":5,"last update":"Thu Jul 20 15:04:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.39400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]}]},{"osd":4,"up_from":40,"seq":171798691859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049180,"kb_used_data":596,"kb_used_omap":7,"kb_used_meta":1048568,"kb_avail":92695972,"statfs":{"total":95995035648,"available":94920675328,"internally_reserved":1073741824,"allocated":610304,"data_stored":243120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7754,"internal_metadata":1073734070},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 15:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.438},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jul 20 15:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jul 20 15:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jul 20 15:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.38},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.37}]},{"osd":5,"last update":"Thu Jul 20 15:04:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]}]},{"osd":5,"up_from":48,"seq":206158430224,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049176,"kb_used_data":592,"kb_used_omap":9,"kb_used_meta":1048566,"kb_avail":92695976,"statfs":{"total":95995035648,"available":94920679424,"internally_reserved":1073741824,"allocated":606208,"data_stored":242826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9234,"internal_metadata":1073732590},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 15:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Jul 20 15:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jul 20 15:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jul 20 15:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jul 20 15:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]}]}} 2023-07-20T15:04:17.326 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph pg dump --format=json 2023-07-20T15:04:18.493 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T15:04:18.494 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-07-20T15:04:18.867 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2023-07-20T15:04:17.820590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":8393428,"kb_used_data":4756,"kb_used_omap":42,"kb_used_meta":8388565,"kb_avail":741567788,"statfs":{"total":767960285184,"available":759365414912,"internally_reserved":8589934592,"allocated":4870144,"data_stored":1944078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43599,"internal_metadata":8589890993},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002156"},"pg_stats":[{"pgid":"1.0","version":"21'1","reported_seq":"14","reported_epoch":"61","state":"active+clean","last_fresh":"2023-07-20T15:03:23.950036+0000","last_change":"2023-07-20T15:03:23.950036+0000","last_active":"2023-07-20T15:03:23.950036+0000","last_peered":"2023-07-20T15:03:23.950036+0000","last_clean":"2023-07-20T15:03:23.950036+0000","last_became_active":"2023-07-20T15:03:23.947582+0000","last_became_peered":"2023-07-20T15:03:23.947582+0000","last_unstale":"2023-07-20T15:03:23.950036+0000","last_undegraded":"2023-07-20T15:03:23.950036+0000","last_fullsized":"2023-07-20T15:03:23.950036+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T14:59:50.222895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T14:59:50.222895+0000","last_clean_scrub_stamp":"2023-07-20T14:59:50.222895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33482,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":60,"seq":257698037773,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049180,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695972,"statfs":{"total":95995035648,"available":94920675328,"internally_reserved":1073741824,"allocated":610304,"data_stored":243120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":6,"up_from":57,"seq":244813135885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049180,"kb_used_data":596,"kb_used_omap":7,"kb_used_meta":1048568,"kb_avail":92695972,"statfs":{"total":95995035648,"available":94920675328,"internally_reserved":1073741824,"allocated":610304,"data_stored":243120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7608,"internal_metadata":1073734216},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]},{"osd":1,"up_from":20,"seq":85899345947,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049180,"kb_used_data":596,"kb_used_omap":4,"kb_used_meta":1048571,"kb_avail":92695972,"statfs":{"total":95995035648,"available":94920675328,"internally_reserved":1073741824,"allocated":610304,"data_stored":243120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4994,"internal_metadata":1073736830},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 15:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.35099999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.51800000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.38,"15min":0.38400000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52000000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.20100000000000001}]},{"osd":2,"last update":"Thu Jul 20 15:03:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.312},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jul 20 15:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.249},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.28199999999999997}]},{"osd":4,"last update":"Thu Jul 20 15:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.38800000000000001}]},{"osd":5,"last update":"Thu Jul 20 15:04:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.37}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542174,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049180,"kb_used_data":596,"kb_used_omap":5,"kb_used_meta":1048570,"kb_avail":92695972,"statfs":{"total":95995035648,"available":94920675328,"internally_reserved":1073741824,"allocated":610304,"data_stored":243120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5123,"internal_metadata":1073736701},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 15:04:13 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.48299999999999998,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.36699999999999999,"15min":0.36899999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jul 20 15:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.433}]},{"osd":3,"last update":"Thu Jul 20 15:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.375}]},{"osd":4,"last update":"Thu Jul 20 15:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.497}]},{"osd":5,"last update":"Thu Jul 20 15:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":2,"up_from":27,"seq":115964117016,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049176,"kb_used_data":592,"kb_used_omap":8,"kb_used_meta":1048567,"kb_avail":92695976,"statfs":{"total":95995035648,"available":94920679424,"internally_reserved":1073741824,"allocated":606208,"data_stored":242826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8886,"internal_metadata":1073732938},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 15:03:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jul 20 15:03:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jul 20 15:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jul 20 15:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jul 20 15:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":3,"up_from":31,"seq":133143986200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049176,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695976,"statfs":{"total":95995035648,"available":94920679424,"internally_reserved":1073741824,"allocated":606208,"data_stored":242826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 15:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.249},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.372}]},{"osd":1,"last update":"Thu Jul 20 15:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jul 20 15:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jul 20 15:03:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.435}]},{"osd":5,"last update":"Thu Jul 20 15:04:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.39400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]}]},{"osd":4,"up_from":40,"seq":171798691859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049180,"kb_used_data":596,"kb_used_omap":7,"kb_used_meta":1048568,"kb_avail":92695972,"statfs":{"total":95995035648,"available":94920675328,"internally_reserved":1073741824,"allocated":610304,"data_stored":243120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7754,"internal_metadata":1073734070},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 15:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.438},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jul 20 15:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jul 20 15:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jul 20 15:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.38},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.37}]},{"osd":5,"last update":"Thu Jul 20 15:04:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]}]},{"osd":5,"up_from":48,"seq":206158430224,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049176,"kb_used_data":592,"kb_used_omap":9,"kb_used_meta":1048566,"kb_avail":92695976,"statfs":{"total":95995035648,"available":94920679424,"internally_reserved":1073741824,"allocated":606208,"data_stored":242826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9234,"internal_metadata":1073732590},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 15:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Jul 20 15:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jul 20 15:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jul 20 15:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jul 20 15:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]}]}} 2023-07-20T15:04:18.869 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-07-20T15:04:18.869 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-20T15:04:18.869 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-07-20T15:04:18.869 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 021c9860-270e-11ee-9b34-001a4aab830c -- ceph health --format=json 2023-07-20T15:04:18.913 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:18 smithi029 bash[104935]: audit 2023-07-20T15:04:16.923762+0000 mgr.y (mgr.14142) 174 : audit [DBG] from='client.14598 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-20T15:04:18.913 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:18 smithi029 bash[104935]: cluster 2023-07-20T15:04:17.820817+0000 mgr.y (mgr.14142) 175 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:18.913 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:18 smithi029 bash[108361]: audit 2023-07-20T15:04:16.923762+0000 mgr.y (mgr.14142) 174 : audit [DBG] from='client.14598 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-20T15:04:18.913 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:18 smithi029 bash[108361]: cluster 2023-07-20T15:04:17.820817+0000 mgr.y (mgr.14142) 175 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:19.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:18 smithi178 bash[104918]: audit 2023-07-20T15:04:16.923762+0000 mgr.y (mgr.14142) 174 : audit [DBG] from='client.14598 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-20T15:04:19.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:18 smithi178 bash[104918]: cluster 2023-07-20T15:04:17.820817+0000 mgr.y (mgr.14142) 175 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:20.091 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-07-20T15:04:20.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:19 smithi178 bash[104918]: audit 2023-07-20T15:04:18.446007+0000 mgr.y (mgr.14142) 176 : audit [DBG] from='client.14604 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-20T15:04:20.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:19 smithi029 bash[104935]: audit 2023-07-20T15:04:18.446007+0000 mgr.y (mgr.14142) 176 : audit [DBG] from='client.14604 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-20T15:04:20.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:19 smithi029 bash[108361]: audit 2023-07-20T15:04:18.446007+0000 mgr.y (mgr.14142) 176 : audit [DBG] from='client.14604 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-20T15:04:20.448 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-20T15:04:20.449 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-07-20T15:04:20.449 INFO:tasks.cephadm:Setup complete, yielding 2023-07-20T15:04:20.449 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-07-20T15:04:20.479 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi029.front.sepia.ceph.com 2023-07-20T15:04:20.488 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2023-07-20T15:04:21.160 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:20 smithi029 bash[104935]: cluster 2023-07-20T15:04:19.821209+0000 mgr.y (mgr.14142) 177 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:21.160 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:20 smithi029 bash[104935]: audit 2023-07-20T15:04:20.042880+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.15.29:0/1812894425' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-07-20T15:04:21.161 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:20 smithi029 bash[108361]: cluster 2023-07-20T15:04:19.821209+0000 mgr.y (mgr.14142) 177 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:21.161 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:20 smithi029 bash[108361]: audit 2023-07-20T15:04:20.042880+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.15.29:0/1812894425' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-07-20T15:04:21.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:20 smithi178 bash[104918]: cluster 2023-07-20T15:04:19.821209+0000 mgr.y (mgr.14142) 177 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:21.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:20 smithi178 bash[104918]: audit 2023-07-20T15:04:20.042880+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.15.29:0/1812894425' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-07-20T15:04:22.924 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-07-20T15:04:22.925 INFO:teuthology.orchestra.run.smithi029.stdout: "id": "7867c9b1-c3e8-4dfe-8d26-6673f706c2c8", 2023-07-20T15:04:22.925 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "r", 2023-07-20T15:04:22.925 INFO:teuthology.orchestra.run.smithi029.stdout: "current_period": "7e35edd9-e549-4e4d-981e-9e5781de3d35", 2023-07-20T15:04:22.925 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 1 2023-07-20T15:04:22.925 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-07-20T15:04:23.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:22 smithi178 bash[104918]: cluster 2023-07-20T15:04:21.821447+0000 mgr.y (mgr.14142) 178 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:23.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:22 smithi178 bash[104918]: cluster 2023-07-20T15:04:21.840232+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2023-07-20T15:04:23.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:22 smithi178 bash[104918]: audit 2023-07-20T15:04:21.840830+0000 mon.a (mon.0) 739 : audit [INF] from='client.? 172.21.15.29:0/2134968020' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2023-07-20T15:04:23.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:22 smithi029 bash[108361]: cluster 2023-07-20T15:04:21.821447+0000 mgr.y (mgr.14142) 178 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:23.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:22 smithi029 bash[108361]: cluster 2023-07-20T15:04:21.840232+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2023-07-20T15:04:23.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:22 smithi029 bash[108361]: audit 2023-07-20T15:04:21.840830+0000 mon.a (mon.0) 739 : audit [INF] from='client.? 172.21.15.29:0/2134968020' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2023-07-20T15:04:23.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:22 smithi029 bash[104935]: cluster 2023-07-20T15:04:21.821447+0000 mgr.y (mgr.14142) 178 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 4.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:23.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:22 smithi029 bash[104935]: cluster 2023-07-20T15:04:21.840232+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2023-07-20T15:04:23.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:22 smithi029 bash[104935]: audit 2023-07-20T15:04:21.840830+0000 mon.a (mon.0) 739 : audit [INF] from='client.? 172.21.15.29:0/2134968020' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2023-07-20T15:04:23.311 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2023-07-20T15:04:24.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:23 smithi178 bash[104918]: audit 2023-07-20T15:04:22.843151+0000 mon.a (mon.0) 740 : audit [INF] from='client.? 172.21.15.29:0/2134968020' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2023-07-20T15:04:24.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:23 smithi178 bash[104918]: cluster 2023-07-20T15:04:22.843512+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2023-07-20T15:04:24.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:23 smithi178 bash[104918]: cluster 2023-07-20T15:04:23.821833+0000 mgr.y (mgr.14142) 179 : cluster [DBG] pgmap v175: 33 pgs: 24 active+clean, 3 creating+peering, 6 unknown; 516 B data, 4.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s wr, 1 op/s 2023-07-20T15:04:24.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:23 smithi178 bash[104918]: cluster 2023-07-20T15:04:23.843894+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2023-07-20T15:04:24.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:23 smithi029 bash[104935]: audit 2023-07-20T15:04:22.843151+0000 mon.a (mon.0) 740 : audit [INF] from='client.? 172.21.15.29:0/2134968020' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2023-07-20T15:04:24.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:23 smithi029 bash[104935]: cluster 2023-07-20T15:04:22.843512+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2023-07-20T15:04:24.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:23 smithi029 bash[104935]: cluster 2023-07-20T15:04:23.821833+0000 mgr.y (mgr.14142) 179 : cluster [DBG] pgmap v175: 33 pgs: 24 active+clean, 3 creating+peering, 6 unknown; 516 B data, 4.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s wr, 1 op/s 2023-07-20T15:04:24.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:23 smithi029 bash[104935]: cluster 2023-07-20T15:04:23.843894+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2023-07-20T15:04:24.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:23 smithi029 bash[108361]: audit 2023-07-20T15:04:22.843151+0000 mon.a (mon.0) 740 : audit [INF] from='client.? 172.21.15.29:0/2134968020' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2023-07-20T15:04:24.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:23 smithi029 bash[108361]: cluster 2023-07-20T15:04:22.843512+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2023-07-20T15:04:24.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:23 smithi029 bash[108361]: cluster 2023-07-20T15:04:23.821833+0000 mgr.y (mgr.14142) 179 : cluster [DBG] pgmap v175: 33 pgs: 24 active+clean, 3 creating+peering, 6 unknown; 516 B data, 4.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s wr, 1 op/s 2023-07-20T15:04:24.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:23 smithi029 bash[108361]: cluster 2023-07-20T15:04:23.843894+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2023-07-20T15:04:24.324 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-07-20T15:04:24.325 INFO:teuthology.orchestra.run.smithi029.stdout: "id": "4037180c-455a-4a15-bb68-f696d9739546", 2023-07-20T15:04:24.325 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "default", 2023-07-20T15:04:24.325 INFO:teuthology.orchestra.run.smithi029.stdout: "api_name": "default", 2023-07-20T15:04:24.325 INFO:teuthology.orchestra.run.smithi029.stdout: "is_master": "true", 2023-07-20T15:04:24.325 INFO:teuthology.orchestra.run.smithi029.stdout: "endpoints": [], 2023-07-20T15:04:24.326 INFO:teuthology.orchestra.run.smithi029.stdout: "hostnames": [], 2023-07-20T15:04:24.326 INFO:teuthology.orchestra.run.smithi029.stdout: "hostnames_s3website": [], 2023-07-20T15:04:24.326 INFO:teuthology.orchestra.run.smithi029.stdout: "master_zone": "", 2023-07-20T15:04:24.326 INFO:teuthology.orchestra.run.smithi029.stdout: "zones": [], 2023-07-20T15:04:24.326 INFO:teuthology.orchestra.run.smithi029.stdout: "placement_targets": [], 2023-07-20T15:04:24.326 INFO:teuthology.orchestra.run.smithi029.stdout: "default_placement": "", 2023-07-20T15:04:24.326 INFO:teuthology.orchestra.run.smithi029.stdout: "realm_id": "7867c9b1-c3e8-4dfe-8d26-6673f706c2c8", 2023-07-20T15:04:24.326 INFO:teuthology.orchestra.run.smithi029.stdout: "sync_policy": { 2023-07-20T15:04:24.327 INFO:teuthology.orchestra.run.smithi029.stdout: "groups": [] 2023-07-20T15:04:24.327 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-07-20T15:04:24.327 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-07-20T15:04:24.649 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2023-07-20T15:04:25.589 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-07-20T15:04:25.589 INFO:teuthology.orchestra.run.smithi029.stdout: "id": "b05deee7-652a-4cf4-bc5b-516ddc46af24", 2023-07-20T15:04:25.589 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "z", 2023-07-20T15:04:25.589 INFO:teuthology.orchestra.run.smithi029.stdout: "domain_root": "z.rgw.meta:root", 2023-07-20T15:04:25.590 INFO:teuthology.orchestra.run.smithi029.stdout: "control_pool": "z.rgw.control", 2023-07-20T15:04:25.590 INFO:teuthology.orchestra.run.smithi029.stdout: "gc_pool": "z.rgw.log:gc", 2023-07-20T15:04:25.590 INFO:teuthology.orchestra.run.smithi029.stdout: "lc_pool": "z.rgw.log:lc", 2023-07-20T15:04:25.590 INFO:teuthology.orchestra.run.smithi029.stdout: "log_pool": "z.rgw.log", 2023-07-20T15:04:25.590 INFO:teuthology.orchestra.run.smithi029.stdout: "intent_log_pool": "z.rgw.log:intent", 2023-07-20T15:04:25.590 INFO:teuthology.orchestra.run.smithi029.stdout: "usage_log_pool": "z.rgw.log:usage", 2023-07-20T15:04:25.590 INFO:teuthology.orchestra.run.smithi029.stdout: "roles_pool": "z.rgw.meta:roles", 2023-07-20T15:04:25.590 INFO:teuthology.orchestra.run.smithi029.stdout: "reshard_pool": "z.rgw.log:reshard", 2023-07-20T15:04:25.598 INFO:teuthology.orchestra.run.smithi029.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2023-07-20T15:04:25.599 INFO:teuthology.orchestra.run.smithi029.stdout: "user_email_pool": "z.rgw.meta:users.email", 2023-07-20T15:04:25.599 INFO:teuthology.orchestra.run.smithi029.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2023-07-20T15:04:25.599 INFO:teuthology.orchestra.run.smithi029.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2023-07-20T15:04:25.599 INFO:teuthology.orchestra.run.smithi029.stdout: "otp_pool": "z.rgw.otp", 2023-07-20T15:04:25.599 INFO:teuthology.orchestra.run.smithi029.stdout: "system_key": { 2023-07-20T15:04:25.599 INFO:teuthology.orchestra.run.smithi029.stdout: "access_key": "", 2023-07-20T15:04:25.600 INFO:teuthology.orchestra.run.smithi029.stdout: "secret_key": "" 2023-07-20T15:04:25.600 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:04:25.600 INFO:teuthology.orchestra.run.smithi029.stdout: "placement_pools": [ 2023-07-20T15:04:25.600 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-07-20T15:04:25.600 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "default-placement", 2023-07-20T15:04:25.600 INFO:teuthology.orchestra.run.smithi029.stdout: "val": { 2023-07-20T15:04:25.601 INFO:teuthology.orchestra.run.smithi029.stdout: "index_pool": "z.rgw.buckets.index", 2023-07-20T15:04:25.601 INFO:teuthology.orchestra.run.smithi029.stdout: "storage_classes": { 2023-07-20T15:04:25.601 INFO:teuthology.orchestra.run.smithi029.stdout: "STANDARD": { 2023-07-20T15:04:25.601 INFO:teuthology.orchestra.run.smithi029.stdout: "data_pool": "z.rgw.buckets.data" 2023-07-20T15:04:25.601 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-07-20T15:04:25.601 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:04:25.601 INFO:teuthology.orchestra.run.smithi029.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2023-07-20T15:04:25.602 INFO:teuthology.orchestra.run.smithi029.stdout: "index_type": 0 2023-07-20T15:04:25.602 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-07-20T15:04:25.602 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-07-20T15:04:25.602 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-07-20T15:04:25.602 INFO:teuthology.orchestra.run.smithi029.stdout: "realm_id": "7867c9b1-c3e8-4dfe-8d26-6673f706c2c8" 2023-07-20T15:04:25.602 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-07-20T15:04:25.961 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2023-07-20T15:04:26.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:25 smithi029 bash[104935]: cluster 2023-07-20T15:04:25.822419+0000 mgr.y (mgr.14142) 180 : cluster [DBG] pgmap v177: 33 pgs: 30 active+clean, 3 creating+peering; 516 B data, 4.9 MiB used, 707 GiB / 715 GiB avail; 1.3 KiB/s wr, 1 op/s 2023-07-20T15:04:26.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:25 smithi029 bash[108361]: cluster 2023-07-20T15:04:25.822419+0000 mgr.y (mgr.14142) 180 : cluster [DBG] pgmap v177: 33 pgs: 30 active+clean, 3 creating+peering; 516 B data, 4.9 MiB used, 707 GiB / 715 GiB avail; 1.3 KiB/s wr, 1 op/s 2023-07-20T15:04:26.419 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:25 smithi178 bash[104918]: cluster 2023-07-20T15:04:25.822419+0000 mgr.y (mgr.14142) 180 : cluster [DBG] pgmap v177: 33 pgs: 30 active+clean, 3 creating+peering; 516 B data, 4.9 MiB used, 707 GiB / 715 GiB avail; 1.3 KiB/s wr, 1 op/s 2023-07-20T15:04:28.919 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:28 smithi178 bash[104918]: cluster 2023-07-20T15:04:27.402356+0000 mon.a (mon.0) 743 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2023-07-20T15:04:28.920 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:28 smithi178 bash[104918]: audit 2023-07-20T15:04:27.403809+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.29:0/2392431857' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2023-07-20T15:04:28.921 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:28 smithi178 bash[104918]: audit 2023-07-20T15:04:27.404201+0000 mon.a (mon.0) 744 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2023-07-20T15:04:28.921 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:28 smithi178 bash[104918]: cluster 2023-07-20T15:04:27.822825+0000 mgr.y (mgr.14142) 181 : cluster [DBG] pgmap v179: 65 pgs: 32 unknown, 30 active+clean, 3 creating+peering; 516 B data, 4.9 MiB used, 707 GiB / 715 GiB avail; 1.3 KiB/s wr, 1 op/s 2023-07-20T15:04:28.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:28 smithi029 bash[104935]: cluster 2023-07-20T15:04:27.402356+0000 mon.a (mon.0) 743 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2023-07-20T15:04:28.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:28 smithi029 bash[104935]: audit 2023-07-20T15:04:27.403809+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.29:0/2392431857' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2023-07-20T15:04:28.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:28 smithi029 bash[104935]: audit 2023-07-20T15:04:27.404201+0000 mon.a (mon.0) 744 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2023-07-20T15:04:28.951 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:28 smithi029 bash[104935]: cluster 2023-07-20T15:04:27.822825+0000 mgr.y (mgr.14142) 181 : cluster [DBG] pgmap v179: 65 pgs: 32 unknown, 30 active+clean, 3 creating+peering; 516 B data, 4.9 MiB used, 707 GiB / 715 GiB avail; 1.3 KiB/s wr, 1 op/s 2023-07-20T15:04:28.951 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:28 smithi029 bash[108361]: cluster 2023-07-20T15:04:27.402356+0000 mon.a (mon.0) 743 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2023-07-20T15:04:28.951 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:28 smithi029 bash[108361]: audit 2023-07-20T15:04:27.403809+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.29:0/2392431857' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2023-07-20T15:04:28.951 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:28 smithi029 bash[108361]: audit 2023-07-20T15:04:27.404201+0000 mon.a (mon.0) 744 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2023-07-20T15:04:28.951 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:28 smithi029 bash[108361]: cluster 2023-07-20T15:04:27.822825+0000 mgr.y (mgr.14142) 181 : cluster [DBG] pgmap v179: 65 pgs: 32 unknown, 30 active+clean, 3 creating+peering; 516 B data, 4.9 MiB used, 707 GiB / 715 GiB avail; 1.3 KiB/s wr, 1 op/s 2023-07-20T15:04:29.919 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:29 smithi178 bash[104918]: audit 2023-07-20T15:04:28.410235+0000 mon.a (mon.0) 745 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2023-07-20T15:04:29.920 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:29 smithi178 bash[104918]: cluster 2023-07-20T15:04:28.410444+0000 mon.a (mon.0) 746 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2023-07-20T15:04:29.950 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:29 smithi029 bash[108361]: audit 2023-07-20T15:04:28.410235+0000 mon.a (mon.0) 745 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2023-07-20T15:04:29.950 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:29 smithi029 bash[108361]: cluster 2023-07-20T15:04:28.410444+0000 mon.a (mon.0) 746 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2023-07-20T15:04:29.951 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:29 smithi029 bash[104935]: audit 2023-07-20T15:04:28.410235+0000 mon.a (mon.0) 745 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2023-07-20T15:04:29.951 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:29 smithi029 bash[104935]: cluster 2023-07-20T15:04:28.410444+0000 mon.a (mon.0) 746 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2023-07-20T15:04:30.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:30 smithi178 bash[104918]: cluster 2023-07-20T15:04:29.410791+0000 mon.a (mon.0) 747 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2023-07-20T15:04:30.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:30 smithi178 bash[104918]: audit 2023-07-20T15:04:29.414444+0000 mon.c (mon.1) 35 : audit [INF] from='client.? 172.21.15.29:0/2392431857' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2023-07-20T15:04:30.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:30 smithi178 bash[104918]: audit 2023-07-20T15:04:29.422042+0000 mon.a (mon.0) 748 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2023-07-20T15:04:30.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:30 smithi178 bash[104918]: cluster 2023-07-20T15:04:29.823178+0000 mgr.y (mgr.14142) 182 : cluster [DBG] pgmap v182: 97 pgs: 32 unknown, 3 creating+activating, 12 creating+peering, 50 active+clean; 1.8 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2023-07-20T15:04:30.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:30 smithi178 bash[104918]: audit 2023-07-20T15:04:30.412673+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2023-07-20T15:04:30.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:30 smithi178 bash[104918]: cluster 2023-07-20T15:04:30.412746+0000 mon.a (mon.0) 750 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2023-07-20T15:04:30.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:30 smithi029 bash[104935]: cluster 2023-07-20T15:04:29.410791+0000 mon.a (mon.0) 747 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2023-07-20T15:04:30.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:30 smithi029 bash[104935]: audit 2023-07-20T15:04:29.414444+0000 mon.c (mon.1) 35 : audit [INF] from='client.? 172.21.15.29:0/2392431857' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2023-07-20T15:04:30.951 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:30 smithi029 bash[104935]: audit 2023-07-20T15:04:29.422042+0000 mon.a (mon.0) 748 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2023-07-20T15:04:30.951 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:30 smithi029 bash[104935]: cluster 2023-07-20T15:04:29.823178+0000 mgr.y (mgr.14142) 182 : cluster [DBG] pgmap v182: 97 pgs: 32 unknown, 3 creating+activating, 12 creating+peering, 50 active+clean; 1.8 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2023-07-20T15:04:30.951 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:30 smithi029 bash[104935]: audit 2023-07-20T15:04:30.412673+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2023-07-20T15:04:30.951 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:30 smithi029 bash[104935]: cluster 2023-07-20T15:04:30.412746+0000 mon.a (mon.0) 750 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2023-07-20T15:04:30.951 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:30 smithi029 bash[108361]: cluster 2023-07-20T15:04:29.410791+0000 mon.a (mon.0) 747 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2023-07-20T15:04:30.952 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:30 smithi029 bash[108361]: audit 2023-07-20T15:04:29.414444+0000 mon.c (mon.1) 35 : audit [INF] from='client.? 172.21.15.29:0/2392431857' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2023-07-20T15:04:30.952 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:30 smithi029 bash[108361]: audit 2023-07-20T15:04:29.422042+0000 mon.a (mon.0) 748 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2023-07-20T15:04:30.952 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:30 smithi029 bash[108361]: cluster 2023-07-20T15:04:29.823178+0000 mgr.y (mgr.14142) 182 : cluster [DBG] pgmap v182: 97 pgs: 32 unknown, 3 creating+activating, 12 creating+peering, 50 active+clean; 1.8 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2023-07-20T15:04:30.952 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:30 smithi029 bash[108361]: audit 2023-07-20T15:04:30.412673+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2023-07-20T15:04:30.952 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:30 smithi029 bash[108361]: cluster 2023-07-20T15:04:30.412746+0000 mon.a (mon.0) 750 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2023-07-20T15:04:32.921 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:32 smithi178 bash[104918]: cluster 2023-07-20T15:04:31.500967+0000 mon.a (mon.0) 751 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2023-07-20T15:04:32.921 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:32 smithi178 bash[104918]: audit 2023-07-20T15:04:31.505426+0000 mon.a (mon.0) 752 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2023-07-20T15:04:32.921 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:32 smithi178 bash[104918]: cluster 2023-07-20T15:04:31.823546+0000 mgr.y (mgr.14142) 183 : cluster [DBG] pgmap v185: 129 pgs: 64 unknown, 3 creating+activating, 12 creating+peering, 50 active+clean; 1.8 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 5.5 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2023-07-20T15:04:32.949 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:32 smithi029 bash[108361]: cluster 2023-07-20T15:04:31.500967+0000 mon.a (mon.0) 751 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2023-07-20T15:04:32.949 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:32 smithi029 bash[108361]: audit 2023-07-20T15:04:31.505426+0000 mon.a (mon.0) 752 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2023-07-20T15:04:32.950 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:32 smithi029 bash[108361]: cluster 2023-07-20T15:04:31.823546+0000 mgr.y (mgr.14142) 183 : cluster [DBG] pgmap v185: 129 pgs: 64 unknown, 3 creating+activating, 12 creating+peering, 50 active+clean; 1.8 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 5.5 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2023-07-20T15:04:32.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:32 smithi029 bash[104935]: cluster 2023-07-20T15:04:31.500967+0000 mon.a (mon.0) 751 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2023-07-20T15:04:32.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:32 smithi029 bash[104935]: audit 2023-07-20T15:04:31.505426+0000 mon.a (mon.0) 752 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2023-07-20T15:04:32.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:32 smithi029 bash[104935]: cluster 2023-07-20T15:04:31.823546+0000 mgr.y (mgr.14142) 183 : cluster [DBG] pgmap v185: 129 pgs: 64 unknown, 3 creating+activating, 12 creating+peering, 50 active+clean; 1.8 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 5.5 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2023-07-20T15:04:33.919 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:33 smithi178 bash[104918]: audit 2023-07-20T15:04:32.507953+0000 mon.a (mon.0) 753 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2023-07-20T15:04:33.919 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:33 smithi178 bash[104918]: cluster 2023-07-20T15:04:32.508087+0000 mon.a (mon.0) 754 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2023-07-20T15:04:33.920 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:33 smithi178 bash[104918]: audit 2023-07-20T15:04:32.518885+0000 mon.a (mon.0) 755 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2023-07-20T15:04:33.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:33 smithi029 bash[104935]: audit 2023-07-20T15:04:32.507953+0000 mon.a (mon.0) 753 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2023-07-20T15:04:33.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:33 smithi029 bash[104935]: cluster 2023-07-20T15:04:32.508087+0000 mon.a (mon.0) 754 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2023-07-20T15:04:33.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:33 smithi029 bash[104935]: audit 2023-07-20T15:04:32.518885+0000 mon.a (mon.0) 755 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2023-07-20T15:04:33.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:33 smithi029 bash[108361]: audit 2023-07-20T15:04:32.507953+0000 mon.a (mon.0) 753 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2023-07-20T15:04:33.955 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:33 smithi029 bash[108361]: cluster 2023-07-20T15:04:32.508087+0000 mon.a (mon.0) 754 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2023-07-20T15:04:33.955 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:33 smithi029 bash[108361]: audit 2023-07-20T15:04:32.518885+0000 mon.a (mon.0) 755 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2023-07-20T15:04:34.654 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-07-20T15:04:34.654 INFO:teuthology.orchestra.run.smithi029.stdout: "id": "f3c66ee7-0d77-4d71-9c13-01ae2edf0c30", 2023-07-20T15:04:34.655 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 1, 2023-07-20T15:04:34.655 INFO:teuthology.orchestra.run.smithi029.stdout: "predecessor_uuid": "7e35edd9-e549-4e4d-981e-9e5781de3d35", 2023-07-20T15:04:34.655 INFO:teuthology.orchestra.run.smithi029.stdout: "sync_status": [], 2023-07-20T15:04:34.655 INFO:teuthology.orchestra.run.smithi029.stdout: "period_map": { 2023-07-20T15:04:34.655 INFO:teuthology.orchestra.run.smithi029.stdout: "id": "f3c66ee7-0d77-4d71-9c13-01ae2edf0c30", 2023-07-20T15:04:34.655 INFO:teuthology.orchestra.run.smithi029.stdout: "zonegroups": [ 2023-07-20T15:04:34.655 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-07-20T15:04:34.656 INFO:teuthology.orchestra.run.smithi029.stdout: "id": "4037180c-455a-4a15-bb68-f696d9739546", 2023-07-20T15:04:34.656 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "default", 2023-07-20T15:04:34.656 INFO:teuthology.orchestra.run.smithi029.stdout: "api_name": "default", 2023-07-20T15:04:34.656 INFO:teuthology.orchestra.run.smithi029.stdout: "is_master": "true", 2023-07-20T15:04:34.656 INFO:teuthology.orchestra.run.smithi029.stdout: "endpoints": [], 2023-07-20T15:04:34.656 INFO:teuthology.orchestra.run.smithi029.stdout: "hostnames": [], 2023-07-20T15:04:34.656 INFO:teuthology.orchestra.run.smithi029.stdout: "hostnames_s3website": [], 2023-07-20T15:04:34.656 INFO:teuthology.orchestra.run.smithi029.stdout: "master_zone": "b05deee7-652a-4cf4-bc5b-516ddc46af24", 2023-07-20T15:04:34.657 INFO:teuthology.orchestra.run.smithi029.stdout: "zones": [ 2023-07-20T15:04:34.657 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-07-20T15:04:34.657 INFO:teuthology.orchestra.run.smithi029.stdout: "id": "b05deee7-652a-4cf4-bc5b-516ddc46af24", 2023-07-20T15:04:34.657 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "z", 2023-07-20T15:04:34.657 INFO:teuthology.orchestra.run.smithi029.stdout: "endpoints": [], 2023-07-20T15:04:34.657 INFO:teuthology.orchestra.run.smithi029.stdout: "log_meta": "false", 2023-07-20T15:04:34.657 INFO:teuthology.orchestra.run.smithi029.stdout: "log_data": "false", 2023-07-20T15:04:34.658 INFO:teuthology.orchestra.run.smithi029.stdout: "bucket_index_max_shards": 11, 2023-07-20T15:04:34.658 INFO:teuthology.orchestra.run.smithi029.stdout: "read_only": "false", 2023-07-20T15:04:34.658 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_type": "", 2023-07-20T15:04:34.658 INFO:teuthology.orchestra.run.smithi029.stdout: "sync_from_all": "true", 2023-07-20T15:04:34.658 INFO:teuthology.orchestra.run.smithi029.stdout: "sync_from": [], 2023-07-20T15:04:34.658 INFO:teuthology.orchestra.run.smithi029.stdout: "redirect_zone": "" 2023-07-20T15:04:34.658 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-07-20T15:04:34.658 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-07-20T15:04:34.659 INFO:teuthology.orchestra.run.smithi029.stdout: "placement_targets": [ 2023-07-20T15:04:34.659 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-07-20T15:04:34.659 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "default-placement", 2023-07-20T15:04:34.659 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2023-07-20T15:04:34.659 INFO:teuthology.orchestra.run.smithi029.stdout: "storage_classes": [ 2023-07-20T15:04:34.659 INFO:teuthology.orchestra.run.smithi029.stdout: "STANDARD" 2023-07-20T15:04:34.659 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-07-20T15:04:34.659 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-07-20T15:04:34.660 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-07-20T15:04:34.660 INFO:teuthology.orchestra.run.smithi029.stdout: "default_placement": "default-placement", 2023-07-20T15:04:34.660 INFO:teuthology.orchestra.run.smithi029.stdout: "realm_id": "7867c9b1-c3e8-4dfe-8d26-6673f706c2c8", 2023-07-20T15:04:34.666 INFO:teuthology.orchestra.run.smithi029.stdout: "sync_policy": { 2023-07-20T15:04:34.666 INFO:teuthology.orchestra.run.smithi029.stdout: "groups": [] 2023-07-20T15:04:34.666 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-07-20T15:04:34.666 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-07-20T15:04:34.666 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-07-20T15:04:34.666 INFO:teuthology.orchestra.run.smithi029.stdout: "short_zone_ids": [ 2023-07-20T15:04:34.666 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-07-20T15:04:34.667 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "b05deee7-652a-4cf4-bc5b-516ddc46af24", 2023-07-20T15:04:34.667 INFO:teuthology.orchestra.run.smithi029.stdout: "val": 2073076053 2023-07-20T15:04:34.667 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-07-20T15:04:34.667 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-07-20T15:04:34.667 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:04:34.667 INFO:teuthology.orchestra.run.smithi029.stdout: "master_zonegroup": "4037180c-455a-4a15-bb68-f696d9739546", 2023-07-20T15:04:34.667 INFO:teuthology.orchestra.run.smithi029.stdout: "master_zone": "b05deee7-652a-4cf4-bc5b-516ddc46af24", 2023-07-20T15:04:34.668 INFO:teuthology.orchestra.run.smithi029.stdout: "period_config": { 2023-07-20T15:04:34.668 INFO:teuthology.orchestra.run.smithi029.stdout: "bucket_quota": { 2023-07-20T15:04:34.668 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2023-07-20T15:04:34.668 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2023-07-20T15:04:34.668 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2023-07-20T15:04:34.668 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2023-07-20T15:04:34.668 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2023-07-20T15:04:34.669 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:04:34.669 INFO:teuthology.orchestra.run.smithi029.stdout: "user_quota": { 2023-07-20T15:04:34.669 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2023-07-20T15:04:34.669 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2023-07-20T15:04:34.669 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2023-07-20T15:04:34.670 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2023-07-20T15:04:34.670 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2023-07-20T15:04:34.671 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-07-20T15:04:34.671 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:04:34.671 INFO:teuthology.orchestra.run.smithi029.stdout: "realm_id": "7867c9b1-c3e8-4dfe-8d26-6673f706c2c8", 2023-07-20T15:04:34.671 INFO:teuthology.orchestra.run.smithi029.stdout: "realm_name": "r", 2023-07-20T15:04:34.671 INFO:teuthology.orchestra.run.smithi029.stdout: "realm_epoch": 2 2023-07-20T15:04:34.671 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-07-20T15:04:34.829 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:34 smithi029 bash[104935]: audit 2023-07-20T15:04:33.508682+0000 mon.a (mon.0) 756 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2023-07-20T15:04:34.829 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:34 smithi029 bash[104935]: cluster 2023-07-20T15:04:33.508732+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2023-07-20T15:04:34.829 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:34 smithi029 bash[104935]: audit 2023-07-20T15:04:33.509642+0000 mon.a (mon.0) 758 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2023-07-20T15:04:34.829 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:34 smithi029 bash[104935]: cluster 2023-07-20T15:04:33.823999+0000 mgr.y (mgr.14142) 184 : cluster [DBG] pgmap v188: 129 pgs: 19 unknown, 110 active+clean; 1.8 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:34.830 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:34 smithi029 bash[104935]: audit 2023-07-20T15:04:34.510410+0000 mon.a (mon.0) 759 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2023-07-20T15:04:34.830 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:34 smithi029 bash[104935]: cluster 2023-07-20T15:04:34.510491+0000 mon.a (mon.0) 760 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2023-07-20T15:04:34.830 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:34 smithi029 bash[108361]: audit 2023-07-20T15:04:33.508682+0000 mon.a (mon.0) 756 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2023-07-20T15:04:34.830 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:34 smithi029 bash[108361]: cluster 2023-07-20T15:04:33.508732+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2023-07-20T15:04:34.830 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:34 smithi029 bash[108361]: audit 2023-07-20T15:04:33.509642+0000 mon.a (mon.0) 758 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2023-07-20T15:04:34.830 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:34 smithi029 bash[108361]: cluster 2023-07-20T15:04:33.823999+0000 mgr.y (mgr.14142) 184 : cluster [DBG] pgmap v188: 129 pgs: 19 unknown, 110 active+clean; 1.8 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:34.831 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:34 smithi029 bash[108361]: audit 2023-07-20T15:04:34.510410+0000 mon.a (mon.0) 759 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2023-07-20T15:04:34.831 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:34 smithi029 bash[108361]: cluster 2023-07-20T15:04:34.510491+0000 mon.a (mon.0) 760 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2023-07-20T15:04:34.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:34 smithi178 bash[104918]: audit 2023-07-20T15:04:33.508682+0000 mon.a (mon.0) 756 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2023-07-20T15:04:34.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:34 smithi178 bash[104918]: cluster 2023-07-20T15:04:33.508732+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2023-07-20T15:04:34.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:34 smithi178 bash[104918]: audit 2023-07-20T15:04:33.509642+0000 mon.a (mon.0) 758 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2023-07-20T15:04:34.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:34 smithi178 bash[104918]: cluster 2023-07-20T15:04:33.823999+0000 mgr.y (mgr.14142) 184 : cluster [DBG] pgmap v188: 129 pgs: 19 unknown, 110 active+clean; 1.8 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:34.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:34 smithi178 bash[104918]: audit 2023-07-20T15:04:34.510410+0000 mon.a (mon.0) 759 : audit [INF] from='client.? 172.21.15.29:0/334713743' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2023-07-20T15:04:34.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:34 smithi178 bash[104918]: cluster 2023-07-20T15:04:34.510491+0000 mon.a (mon.0) 760 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2023-07-20T15:04:35.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'ceph orch apply rgw r z --placement=2 --port=8000' 2023-07-20T15:04:35.975 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:35 smithi029 bash[104935]: cluster 2023-07-20T15:04:35.826078+0000 mgr.y (mgr.14142) 185 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 1.8 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:35.976 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:35 smithi029 bash[108361]: cluster 2023-07-20T15:04:35.826078+0000 mgr.y (mgr.14142) 185 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 1.8 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:36.285 INFO:teuthology.orchestra.run.smithi029.stdout:Scheduled rgw update... 2023-07-20T15:04:36.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:35 smithi178 bash[104918]: cluster 2023-07-20T15:04:35.826078+0000 mgr.y (mgr.14142) 185 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 1.8 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:36.646 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'sleep 120' 2023-07-20T15:04:37.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[104935]: audit 2023-07-20T15:04:36.235408+0000 mgr.y (mgr.14142) 186 : audit [DBG] from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:04:37.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[104935]: cephadm 2023-07-20T15:04:36.235930+0000 mgr.y (mgr.14142) 187 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2023-07-20T15:04:37.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[104935]: audit 2023-07-20T15:04:36.236244+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2023-07-20T15:04:36.235948\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2023-07-20T15:04:37.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[104935]: audit 2023-07-20T15:04:36.238938+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2023-07-20T15:04:36.235948\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2023-07-20T15:04:37.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[104935]: audit 2023-07-20T15:04:36.240740+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2023-07-20T15:04:37.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[104935]: audit 2023-07-20T15:04:36.244587+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2023-07-20T15:04:37.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[104935]: audit 2023-07-20T15:04:36.245381+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2023-07-20T15:04:37.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[104935]: audit 2023-07-20T15:04:36.248818+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2023-07-20T15:04:37.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[104935]: audit 2023-07-20T15:04:36.249609+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]: dispatch 2023-07-20T15:04:37.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[104935]: audit 2023-07-20T15:04:36.253104+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]': finished 2023-07-20T15:04:37.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[104935]: audit 2023-07-20T15:04:36.253931+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi029.fdztmk", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2023-07-20T15:04:37.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[104935]: audit 2023-07-20T15:04:36.256820+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi029.fdztmk", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2023-07-20T15:04:37.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[104935]: audit 2023-07-20T15:04:36.257444+0000 mon.a (mon.0) 771 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:04:37.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[104935]: cephadm 2023-07-20T15:04:36.257870+0000 mgr.y (mgr.14142) 188 : cephadm [INF] Deploying daemon rgw.r.z.smithi029.fdztmk on smithi029 2023-07-20T15:04:37.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[104935]: audit 2023-07-20T15:04:36.258102+0000 mon.a (mon.0) 772 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi029.fdztmk", "key": "container_image"}]: dispatch 2023-07-20T15:04:37.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[108361]: audit 2023-07-20T15:04:36.235408+0000 mgr.y (mgr.14142) 186 : audit [DBG] from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:04:37.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[108361]: cephadm 2023-07-20T15:04:36.235930+0000 mgr.y (mgr.14142) 187 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2023-07-20T15:04:37.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[108361]: audit 2023-07-20T15:04:36.236244+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2023-07-20T15:04:36.235948\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2023-07-20T15:04:37.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[108361]: audit 2023-07-20T15:04:36.238938+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2023-07-20T15:04:36.235948\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2023-07-20T15:04:37.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[108361]: audit 2023-07-20T15:04:36.240740+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2023-07-20T15:04:37.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[108361]: audit 2023-07-20T15:04:36.244587+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2023-07-20T15:04:37.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[108361]: audit 2023-07-20T15:04:36.245381+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2023-07-20T15:04:37.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[108361]: audit 2023-07-20T15:04:36.248818+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2023-07-20T15:04:37.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[108361]: audit 2023-07-20T15:04:36.249609+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]: dispatch 2023-07-20T15:04:37.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[108361]: audit 2023-07-20T15:04:36.253104+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]': finished 2023-07-20T15:04:37.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[108361]: audit 2023-07-20T15:04:36.253931+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi029.fdztmk", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2023-07-20T15:04:37.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[108361]: audit 2023-07-20T15:04:36.256820+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi029.fdztmk", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2023-07-20T15:04:37.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[108361]: audit 2023-07-20T15:04:36.257444+0000 mon.a (mon.0) 771 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:04:37.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[108361]: cephadm 2023-07-20T15:04:36.257870+0000 mgr.y (mgr.14142) 188 : cephadm [INF] Deploying daemon rgw.r.z.smithi029.fdztmk on smithi029 2023-07-20T15:04:37.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:36 smithi029 bash[108361]: audit 2023-07-20T15:04:36.258102+0000 mon.a (mon.0) 772 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi029.fdztmk", "key": "container_image"}]: dispatch 2023-07-20T15:04:37.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:36 smithi178 bash[104918]: audit 2023-07-20T15:04:36.235408+0000 mgr.y (mgr.14142) 186 : audit [DBG] from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:04:37.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:36 smithi178 bash[104918]: cephadm 2023-07-20T15:04:36.235930+0000 mgr.y (mgr.14142) 187 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2023-07-20T15:04:37.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:36 smithi178 bash[104918]: audit 2023-07-20T15:04:36.236244+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2023-07-20T15:04:36.235948\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2023-07-20T15:04:37.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:36 smithi178 bash[104918]: audit 2023-07-20T15:04:36.238938+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2023-07-20T15:04:36.235948\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2023-07-20T15:04:37.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:36 smithi178 bash[104918]: audit 2023-07-20T15:04:36.240740+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2023-07-20T15:04:37.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:36 smithi178 bash[104918]: audit 2023-07-20T15:04:36.244587+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2023-07-20T15:04:37.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:36 smithi178 bash[104918]: audit 2023-07-20T15:04:36.245381+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2023-07-20T15:04:37.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:36 smithi178 bash[104918]: audit 2023-07-20T15:04:36.248818+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2023-07-20T15:04:37.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:36 smithi178 bash[104918]: audit 2023-07-20T15:04:36.249609+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]: dispatch 2023-07-20T15:04:37.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:36 smithi178 bash[104918]: audit 2023-07-20T15:04:36.253104+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]': finished 2023-07-20T15:04:37.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:36 smithi178 bash[104918]: audit 2023-07-20T15:04:36.253931+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi029.fdztmk", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2023-07-20T15:04:37.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:36 smithi178 bash[104918]: audit 2023-07-20T15:04:36.256820+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi029.fdztmk", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2023-07-20T15:04:37.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:36 smithi178 bash[104918]: audit 2023-07-20T15:04:36.257444+0000 mon.a (mon.0) 771 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:04:37.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:36 smithi178 bash[104918]: cephadm 2023-07-20T15:04:36.257870+0000 mgr.y (mgr.14142) 188 : cephadm [INF] Deploying daemon rgw.r.z.smithi029.fdztmk on smithi029 2023-07-20T15:04:37.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:36 smithi178 bash[104918]: audit 2023-07-20T15:04:36.258102+0000 mon.a (mon.0) 772 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi029.fdztmk", "key": "container_image"}]: dispatch 2023-07-20T15:04:38.207 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:37 smithi029 bash[104935]: audit 2023-07-20T15:04:37.569115+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588413\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588488\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588523\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588554\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588584\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588614\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588644\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588674\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588704\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}, \"rgw.r.z.smithi029.fdztmk\": {\"hostname\": \"smithi029\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:04:38.208 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:37 smithi029 bash[104935]: audit 2023-07-20T15:04:37.572293+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588413\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588488\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588523\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588554\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588584\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588614\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588644\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588674\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588704\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}, \"rgw.r.z.smithi029.fdztmk\": {\"hostname\": \"smithi029\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:04:38.208 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:37 smithi029 bash[104935]: audit 2023-07-20T15:04:37.572844+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi178.bnfxtc", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2023-07-20T15:04:38.208 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:37 smithi029 bash[104935]: audit 2023-07-20T15:04:37.575429+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi178.bnfxtc", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2023-07-20T15:04:38.208 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:37 smithi029 bash[104935]: audit 2023-07-20T15:04:37.576051+0000 mon.a (mon.0) 777 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:04:38.208 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:37 smithi029 bash[104935]: cephadm 2023-07-20T15:04:37.576503+0000 mgr.y (mgr.14142) 189 : cephadm [INF] Deploying daemon rgw.r.z.smithi178.bnfxtc on smithi178 2023-07-20T15:04:38.208 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:37 smithi029 bash[104935]: audit 2023-07-20T15:04:37.576794+0000 mon.a (mon.0) 778 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi178.bnfxtc", "key": "container_image"}]: dispatch 2023-07-20T15:04:38.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:37 smithi029 bash[104935]: cluster 2023-07-20T15:04:37.826383+0000 mgr.y (mgr.14142) 190 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 1.8 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:38.209 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:37 smithi029 bash[108361]: audit 2023-07-20T15:04:37.569115+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588413\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588488\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588523\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588554\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588584\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588614\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588644\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588674\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588704\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}, \"rgw.r.z.smithi029.fdztmk\": {\"hostname\": \"smithi029\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:04:38.209 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:37 smithi029 bash[108361]: audit 2023-07-20T15:04:37.572293+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588413\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588488\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588523\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588554\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588584\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588614\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588644\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588674\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588704\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}, \"rgw.r.z.smithi029.fdztmk\": {\"hostname\": \"smithi029\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:04:38.209 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:37 smithi029 bash[108361]: audit 2023-07-20T15:04:37.572844+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi178.bnfxtc", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2023-07-20T15:04:38.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:37 smithi029 bash[108361]: audit 2023-07-20T15:04:37.575429+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi178.bnfxtc", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2023-07-20T15:04:38.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:37 smithi029 bash[108361]: audit 2023-07-20T15:04:37.576051+0000 mon.a (mon.0) 777 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:04:38.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:37 smithi029 bash[108361]: cephadm 2023-07-20T15:04:37.576503+0000 mgr.y (mgr.14142) 189 : cephadm [INF] Deploying daemon rgw.r.z.smithi178.bnfxtc on smithi178 2023-07-20T15:04:38.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:37 smithi029 bash[108361]: audit 2023-07-20T15:04:37.576794+0000 mon.a (mon.0) 778 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi178.bnfxtc", "key": "container_image"}]: dispatch 2023-07-20T15:04:38.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:37 smithi029 bash[108361]: cluster 2023-07-20T15:04:37.826383+0000 mgr.y (mgr.14142) 190 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 1.8 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:38.321 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:37 smithi178 bash[104918]: audit 2023-07-20T15:04:37.569115+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588413\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588488\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588523\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588554\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588584\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588614\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588644\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588674\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588704\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}, \"rgw.r.z.smithi029.fdztmk\": {\"hostname\": \"smithi029\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:04:38.321 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:37 smithi178 bash[104918]: audit 2023-07-20T15:04:37.572293+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588413\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588488\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588523\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588554\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588584\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588614\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588644\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588674\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:08.588704\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}, \"rgw.r.z.smithi029.fdztmk\": {\"hostname\": \"smithi029\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:04:38.321 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:37 smithi178 bash[104918]: audit 2023-07-20T15:04:37.572844+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi178.bnfxtc", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2023-07-20T15:04:38.322 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:37 smithi178 bash[104918]: audit 2023-07-20T15:04:37.575429+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi178.bnfxtc", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2023-07-20T15:04:38.322 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:37 smithi178 bash[104918]: audit 2023-07-20T15:04:37.576051+0000 mon.a (mon.0) 777 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:04:38.322 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:37 smithi178 bash[104918]: cephadm 2023-07-20T15:04:37.576503+0000 mgr.y (mgr.14142) 189 : cephadm [INF] Deploying daemon rgw.r.z.smithi178.bnfxtc on smithi178 2023-07-20T15:04:38.322 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:37 smithi178 bash[104918]: audit 2023-07-20T15:04:37.576794+0000 mon.a (mon.0) 778 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi178.bnfxtc", "key": "container_image"}]: dispatch 2023-07-20T15:04:38.322 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:37 smithi178 bash[104918]: cluster 2023-07-20T15:04:37.826383+0000 mgr.y (mgr.14142) 190 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 1.8 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:39.920 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:39 smithi178 bash[104918]: audit 2023-07-20T15:04:38.824531+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567703\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567778\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567812\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567843\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567872\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567901\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567932\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567961\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567990\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:04:39.921 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:39 smithi178 bash[104918]: audit 2023-07-20T15:04:38.827553+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567703\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567778\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567812\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567843\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567872\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567901\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567932\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567961\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567990\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:04:39.921 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:39 smithi178 bash[104918]: audit 2023-07-20T15:04:38.828281+0000 mon.a (mon.0) 781 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:39.931 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:39 smithi029 bash[108361]: audit 2023-07-20T15:04:38.824531+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567703\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567778\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567812\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567843\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567872\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567901\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567932\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567961\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567990\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:04:39.932 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:39 smithi029 bash[104935]: audit 2023-07-20T15:04:38.824531+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567703\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567778\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567812\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567843\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567872\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567901\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567932\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567961\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567990\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:04:39.933 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:39 smithi029 bash[108361]: audit 2023-07-20T15:04:38.827553+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567703\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567778\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567812\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567843\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567872\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567901\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567932\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567961\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567990\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:04:39.933 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:39 smithi029 bash[108361]: audit 2023-07-20T15:04:38.828281+0000 mon.a (mon.0) 781 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:39.934 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:39 smithi029 bash[104935]: audit 2023-07-20T15:04:38.827553+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567703\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567778\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567812\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567843\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567872\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567901\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567932\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567961\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:10.567990\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:04:39.934 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:39 smithi029 bash[104935]: audit 2023-07-20T15:04:38.828281+0000 mon.a (mon.0) 781 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:41.139 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:40 smithi178 bash[104918]: cluster 2023-07-20T15:04:39.827103+0000 mgr.y (mgr.14142) 191 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 42 KiB/s rd, 5.5 KiB/s wr, 106 op/s 2023-07-20T15:04:41.140 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:40 smithi178 bash[104918]: audit 2023-07-20T15:04:40.498755+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497560\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497635\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497669\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497700\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497730\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497759\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497789\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497818\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497848\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}, \"rgw.r.z.smithi029.fdztmk\": {\"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497876\", \"created\": \"2023-07-20T15:04:37.533288\", \"started\": \"2023-07-20T15:04:37.674999\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262\"}}, \"last_daemon_update\": \"2023-07-20T15:04:40.497952\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:04:41.140 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:40 smithi178 bash[104918]: audit 2023-07-20T15:04:40.501608+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497560\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497635\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497669\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497700\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497730\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497759\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497789\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497818\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497848\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}, \"rgw.r.z.smithi029.fdztmk\": {\"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497876\", \"created\": \"2023-07-20T15:04:37.533288\", \"started\": \"2023-07-20T15:04:37.674999\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262\"}}, \"last_daemon_update\": \"2023-07-20T15:04:40.497952\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:04:41.140 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:40 smithi178 bash[104918]: audit 2023-07-20T15:04:40.502178+0000 mon.a (mon.0) 784 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:41.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:40 smithi029 bash[104935]: cluster 2023-07-20T15:04:39.827103+0000 mgr.y (mgr.14142) 191 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 42 KiB/s rd, 5.5 KiB/s wr, 106 op/s 2023-07-20T15:04:41.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:40 smithi029 bash[108361]: cluster 2023-07-20T15:04:39.827103+0000 mgr.y (mgr.14142) 191 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 42 KiB/s rd, 5.5 KiB/s wr, 106 op/s 2023-07-20T15:04:41.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:40 smithi029 bash[104935]: audit 2023-07-20T15:04:40.498755+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497560\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497635\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497669\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497700\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497730\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497759\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497789\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497818\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497848\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}, \"rgw.r.z.smithi029.fdztmk\": {\"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497876\", \"created\": \"2023-07-20T15:04:37.533288\", \"started\": \"2023-07-20T15:04:37.674999\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262\"}}, \"last_daemon_update\": \"2023-07-20T15:04:40.497952\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:04:41.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:40 smithi029 bash[104935]: audit 2023-07-20T15:04:40.501608+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497560\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497635\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497669\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497700\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497730\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497759\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497789\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497818\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497848\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}, \"rgw.r.z.smithi029.fdztmk\": {\"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497876\", \"created\": \"2023-07-20T15:04:37.533288\", \"started\": \"2023-07-20T15:04:37.674999\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262\"}}, \"last_daemon_update\": \"2023-07-20T15:04:40.497952\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:04:41.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:40 smithi029 bash[104935]: audit 2023-07-20T15:04:40.502178+0000 mon.a (mon.0) 784 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:41.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:40 smithi029 bash[108361]: audit 2023-07-20T15:04:40.498755+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497560\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497635\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497669\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497700\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497730\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497759\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497789\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497818\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497848\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}, \"rgw.r.z.smithi029.fdztmk\": {\"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497876\", \"created\": \"2023-07-20T15:04:37.533288\", \"started\": \"2023-07-20T15:04:37.674999\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262\"}}, \"last_daemon_update\": \"2023-07-20T15:04:40.497952\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]: dispatch 2023-07-20T15:04:41.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:40 smithi029 bash[108361]: audit 2023-07-20T15:04:40.501608+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497560\", \"created\": \"2023-07-20T14:59:41.218166\", \"started\": \"2023-07-20T14:59:44.521450\"}, \"mgr.y\": {\"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497635\", \"created\": \"2023-07-20T14:59:45.594094\", \"started\": \"2023-07-20T14:59:45.628840\"}, \"mon.c\": {\"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497669\", \"created\": \"2023-07-20T15:00:58.427889\", \"started\": \"2023-07-20T15:00:58.462188\"}, \"osd.0\": {\"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497700\", \"created\": \"2023-07-20T15:01:38.550226\", \"started\": \"2023-07-20T15:01:52.365112\"}, \"osd.1\": {\"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497730\", \"created\": \"2023-07-20T15:01:53.091986\", \"started\": \"2023-07-20T15:02:07.462619\"}, \"osd.2\": {\"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497759\", \"created\": \"2023-07-20T15:02:07.804744\", \"started\": \"2023-07-20T15:02:22.415537\"}, \"osd.3\": {\"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497789\", \"created\": \"2023-07-20T15:02:22.504502\", \"started\": \"2023-07-20T15:02:23.834728\"}, \"node-exporter.a\": {\"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497818\", \"created\": \"2023-07-20T15:03:36.718285\", \"started\": \"2023-07-20T15:03:40.287309\"}, \"alertmanager.a\": {\"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497848\", \"created\": \"2023-07-20T15:03:43.223179\", \"started\": \"2023-07-20T15:03:59.995798\"}, \"rgw.r.z.smithi029.fdztmk\": {\"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:40.497876\", \"created\": \"2023-07-20T15:04:37.533288\", \"started\": \"2023-07-20T15:04:37.674999\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262\"}}, \"last_daemon_update\": \"2023-07-20T15:04:40.497952\", \"last_device_update\": \"2023-07-20T15:02:25.192452\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.29\"]}, \"last_host_check\": \"2023-07-20T15:00:05.643031\"}"}]': finished 2023-07-20T15:04:41.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:40 smithi029 bash[108361]: audit 2023-07-20T15:04:40.502178+0000 mon.a (mon.0) 784 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:04:43.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:42 smithi178 bash[104918]: cluster 2023-07-20T15:04:41.827491+0000 mgr.y (mgr.14142) 192 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 37 KiB/s rd, 4.8 KiB/s wr, 93 op/s 2023-07-20T15:04:43.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:42 smithi178 bash[104918]: audit 2023-07-20T15:04:42.759689+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758220\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758335\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758377\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758414\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758450\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758487\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758523\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758559\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758595\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758654\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_daemon_update\": \"2023-07-20T15:04:42.758768\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:04:43.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:42 smithi178 bash[104918]: audit 2023-07-20T15:04:42.763321+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758220\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758335\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758377\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758414\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758450\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758487\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758523\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758559\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758595\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758654\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_daemon_update\": \"2023-07-20T15:04:42.758768\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:04:43.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:42 smithi029 bash[104935]: cluster 2023-07-20T15:04:41.827491+0000 mgr.y (mgr.14142) 192 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 37 KiB/s rd, 4.8 KiB/s wr, 93 op/s 2023-07-20T15:04:43.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:42 smithi029 bash[108361]: cluster 2023-07-20T15:04:41.827491+0000 mgr.y (mgr.14142) 192 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 37 KiB/s rd, 4.8 KiB/s wr, 93 op/s 2023-07-20T15:04:43.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:42 smithi029 bash[104935]: audit 2023-07-20T15:04:42.759689+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758220\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758335\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758377\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758414\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758450\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758487\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758523\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758559\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758595\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758654\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_daemon_update\": \"2023-07-20T15:04:42.758768\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:04:43.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:42 smithi029 bash[104935]: audit 2023-07-20T15:04:42.763321+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758220\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758335\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758377\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758414\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758450\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758487\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758523\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758559\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758595\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758654\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_daemon_update\": \"2023-07-20T15:04:42.758768\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:04:43.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:42 smithi029 bash[108361]: audit 2023-07-20T15:04:42.759689+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758220\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758335\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758377\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758414\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758450\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758487\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758523\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758559\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758595\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758654\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_daemon_update\": \"2023-07-20T15:04:42.758768\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:04:43.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:42 smithi029 bash[108361]: audit 2023-07-20T15:04:42.763321+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758220\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"851dc06637c7\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758335\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:01:25.291339\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758377\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758414\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758450\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758487\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758523\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758559\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758595\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758654\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:23.948250\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_daemon_update\": \"2023-07-20T15:04:42.758768\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:04:45.169 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:44 smithi178 bash[104918]: cluster 2023-07-20T15:04:43.828326+0000 mgr.y (mgr.14142) 193 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 100 KiB/s rd, 4.1 KiB/s wr, 195 op/s 2023-07-20T15:04:45.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:44 smithi029 bash[104935]: cluster 2023-07-20T15:04:43.828326+0000 mgr.y (mgr.14142) 193 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 100 KiB/s rd, 4.1 KiB/s wr, 195 op/s 2023-07-20T15:04:45.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:44 smithi029 bash[108361]: cluster 2023-07-20T15:04:43.828326+0000 mgr.y (mgr.14142) 193 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 100 KiB/s rd, 4.1 KiB/s wr, 195 op/s 2023-07-20T15:04:47.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:46 smithi178 bash[104918]: cluster 2023-07-20T15:04:45.828795+0000 mgr.y (mgr.14142) 194 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 99 KiB/s rd, 3.6 KiB/s wr, 189 op/s 2023-07-20T15:04:47.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:46 smithi029 bash[104935]: cluster 2023-07-20T15:04:45.828795+0000 mgr.y (mgr.14142) 194 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 99 KiB/s rd, 3.6 KiB/s wr, 189 op/s 2023-07-20T15:04:47.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:46 smithi029 bash[108361]: cluster 2023-07-20T15:04:45.828795+0000 mgr.y (mgr.14142) 194 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 99 KiB/s rd, 3.6 KiB/s wr, 189 op/s 2023-07-20T15:04:49.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:48 smithi178 bash[104918]: cluster 2023-07-20T15:04:47.829194+0000 mgr.y (mgr.14142) 195 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 94 KiB/s rd, 3.4 KiB/s wr, 178 op/s 2023-07-20T15:04:49.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:48 smithi029 bash[104935]: cluster 2023-07-20T15:04:47.829194+0000 mgr.y (mgr.14142) 195 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 94 KiB/s rd, 3.4 KiB/s wr, 178 op/s 2023-07-20T15:04:49.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:48 smithi029 bash[108361]: cluster 2023-07-20T15:04:47.829194+0000 mgr.y (mgr.14142) 195 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 94 KiB/s rd, 3.4 KiB/s wr, 178 op/s 2023-07-20T15:04:51.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:50 smithi178 bash[104918]: cluster 2023-07-20T15:04:49.829897+0000 mgr.y (mgr.14142) 196 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 94 KiB/s rd, 3.4 KiB/s wr, 178 op/s 2023-07-20T15:04:51.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:50 smithi029 bash[104935]: cluster 2023-07-20T15:04:49.829897+0000 mgr.y (mgr.14142) 196 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 94 KiB/s rd, 3.4 KiB/s wr, 178 op/s 2023-07-20T15:04:51.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:50 smithi029 bash[108361]: cluster 2023-07-20T15:04:49.829897+0000 mgr.y (mgr.14142) 196 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 94 KiB/s rd, 3.4 KiB/s wr, 178 op/s 2023-07-20T15:04:53.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:52 smithi178 bash[104918]: cluster 2023-07-20T15:04:51.830295+0000 mgr.y (mgr.14142) 197 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 68 KiB/s rd, 85 B/s wr, 113 op/s 2023-07-20T15:04:53.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:52 smithi029 bash[104935]: cluster 2023-07-20T15:04:51.830295+0000 mgr.y (mgr.14142) 197 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 68 KiB/s rd, 85 B/s wr, 113 op/s 2023-07-20T15:04:53.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:52 smithi029 bash[108361]: cluster 2023-07-20T15:04:51.830295+0000 mgr.y (mgr.14142) 197 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 68 KiB/s rd, 85 B/s wr, 113 op/s 2023-07-20T15:04:55.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:54 smithi178 bash[104918]: cluster 2023-07-20T15:04:53.831020+0000 mgr.y (mgr.14142) 198 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 68 KiB/s rd, 85 B/s wr, 113 op/s 2023-07-20T15:04:55.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:54 smithi029 bash[104935]: cluster 2023-07-20T15:04:53.831020+0000 mgr.y (mgr.14142) 198 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 68 KiB/s rd, 85 B/s wr, 113 op/s 2023-07-20T15:04:55.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:54 smithi029 bash[108361]: cluster 2023-07-20T15:04:53.831020+0000 mgr.y (mgr.14142) 198 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 68 KiB/s rd, 85 B/s wr, 113 op/s 2023-07-20T15:04:57.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:56 smithi178 bash[104918]: cluster 2023-07-20T15:04:55.831496+0000 mgr.y (mgr.14142) 199 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2023-07-20T15:04:57.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:56 smithi029 bash[104935]: cluster 2023-07-20T15:04:55.831496+0000 mgr.y (mgr.14142) 199 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2023-07-20T15:04:57.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:56 smithi029 bash[108361]: cluster 2023-07-20T15:04:55.831496+0000 mgr.y (mgr.14142) 199 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2023-07-20T15:04:59.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:04:58 smithi178 bash[104918]: cluster 2023-07-20T15:04:57.831973+0000 mgr.y (mgr.14142) 200 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:59.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:04:58 smithi029 bash[104935]: cluster 2023-07-20T15:04:57.831973+0000 mgr.y (mgr.14142) 200 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:04:59.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:04:58 smithi029 bash[108361]: cluster 2023-07-20T15:04:57.831973+0000 mgr.y (mgr.14142) 200 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:01.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:00 smithi178 bash[104918]: cluster 2023-07-20T15:04:59.832606+0000 mgr.y (mgr.14142) 201 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:01.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:00 smithi029 bash[104935]: cluster 2023-07-20T15:04:59.832606+0000 mgr.y (mgr.14142) 201 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:01.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:00 smithi029 bash[108361]: cluster 2023-07-20T15:04:59.832606+0000 mgr.y (mgr.14142) 201 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:03.176 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:02 smithi178 bash[104918]: cluster 2023-07-20T15:05:01.833051+0000 mgr.y (mgr.14142) 202 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:03.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:02 smithi029 bash[104935]: cluster 2023-07-20T15:05:01.833051+0000 mgr.y (mgr.14142) 202 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:03.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:02 smithi029 bash[108361]: cluster 2023-07-20T15:05:01.833051+0000 mgr.y (mgr.14142) 202 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:05.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:04 smithi178 bash[104918]: cluster 2023-07-20T15:05:03.833757+0000 mgr.y (mgr.14142) 203 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:05.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:04 smithi029 bash[108361]: cluster 2023-07-20T15:05:03.833757+0000 mgr.y (mgr.14142) 203 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:05.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:04 smithi029 bash[104935]: cluster 2023-07-20T15:05:03.833757+0000 mgr.y (mgr.14142) 203 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:07.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:06 smithi178 bash[104918]: cluster 2023-07-20T15:05:05.834414+0000 mgr.y (mgr.14142) 204 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:07.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:06 smithi029 bash[104935]: cluster 2023-07-20T15:05:05.834414+0000 mgr.y (mgr.14142) 204 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:07.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:06 smithi029 bash[108361]: cluster 2023-07-20T15:05:05.834414+0000 mgr.y (mgr.14142) 204 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:09.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:08 smithi178 bash[104918]: cluster 2023-07-20T15:05:07.834857+0000 mgr.y (mgr.14142) 205 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:09.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:08 smithi029 bash[104935]: cluster 2023-07-20T15:05:07.834857+0000 mgr.y (mgr.14142) 205 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:09.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:08 smithi029 bash[108361]: cluster 2023-07-20T15:05:07.834857+0000 mgr.y (mgr.14142) 205 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:11.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:10 smithi178 bash[104918]: cluster 2023-07-20T15:05:09.835501+0000 mgr.y (mgr.14142) 206 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:11.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:10 smithi029 bash[104935]: cluster 2023-07-20T15:05:09.835501+0000 mgr.y (mgr.14142) 206 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:11.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:10 smithi029 bash[108361]: cluster 2023-07-20T15:05:09.835501+0000 mgr.y (mgr.14142) 206 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:12.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:11 smithi178 bash[104918]: cluster 2023-07-20T15:05:11.836078+0000 mgr.y (mgr.14142) 207 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:12.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:11 smithi029 bash[104935]: cluster 2023-07-20T15:05:11.836078+0000 mgr.y (mgr.14142) 207 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:12.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:11 smithi029 bash[108361]: cluster 2023-07-20T15:05:11.836078+0000 mgr.y (mgr.14142) 207 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:14.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:13 smithi178 bash[104918]: cluster 2023-07-20T15:05:13.836627+0000 mgr.y (mgr.14142) 208 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:14.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:13 smithi029 bash[104935]: cluster 2023-07-20T15:05:13.836627+0000 mgr.y (mgr.14142) 208 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:14.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:13 smithi029 bash[108361]: cluster 2023-07-20T15:05:13.836627+0000 mgr.y (mgr.14142) 208 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:16.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:15 smithi178 bash[104918]: cluster 2023-07-20T15:05:15.837163+0000 mgr.y (mgr.14142) 209 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:16.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:15 smithi029 bash[104935]: cluster 2023-07-20T15:05:15.837163+0000 mgr.y (mgr.14142) 209 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:16.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:15 smithi029 bash[108361]: cluster 2023-07-20T15:05:15.837163+0000 mgr.y (mgr.14142) 209 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:18.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:17 smithi178 bash[104918]: cluster 2023-07-20T15:05:17.837668+0000 mgr.y (mgr.14142) 210 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:18.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:17 smithi029 bash[104935]: cluster 2023-07-20T15:05:17.837668+0000 mgr.y (mgr.14142) 210 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:18.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:17 smithi029 bash[108361]: cluster 2023-07-20T15:05:17.837668+0000 mgr.y (mgr.14142) 210 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:21.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:20 smithi178 bash[104918]: cluster 2023-07-20T15:05:19.838294+0000 mgr.y (mgr.14142) 211 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:21.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:20 smithi029 bash[104935]: cluster 2023-07-20T15:05:19.838294+0000 mgr.y (mgr.14142) 211 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:21.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:20 smithi029 bash[108361]: cluster 2023-07-20T15:05:19.838294+0000 mgr.y (mgr.14142) 211 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:23.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:22 smithi178 bash[104918]: cluster 2023-07-20T15:05:21.838638+0000 mgr.y (mgr.14142) 212 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:23.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:22 smithi029 bash[104935]: cluster 2023-07-20T15:05:21.838638+0000 mgr.y (mgr.14142) 212 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:23.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:22 smithi029 bash[108361]: cluster 2023-07-20T15:05:21.838638+0000 mgr.y (mgr.14142) 212 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:25.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:24 smithi178 bash[104918]: cluster 2023-07-20T15:05:23.839270+0000 mgr.y (mgr.14142) 213 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:25.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:24 smithi029 bash[108361]: cluster 2023-07-20T15:05:23.839270+0000 mgr.y (mgr.14142) 213 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:25.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:24 smithi029 bash[104935]: cluster 2023-07-20T15:05:23.839270+0000 mgr.y (mgr.14142) 213 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:27.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:26 smithi178 bash[104918]: cluster 2023-07-20T15:05:25.839958+0000 mgr.y (mgr.14142) 214 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:27.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:26 smithi029 bash[104935]: cluster 2023-07-20T15:05:25.839958+0000 mgr.y (mgr.14142) 214 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:27.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:26 smithi029 bash[108361]: cluster 2023-07-20T15:05:25.839958+0000 mgr.y (mgr.14142) 214 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:29.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:28 smithi178 bash[104918]: cluster 2023-07-20T15:05:27.840349+0000 mgr.y (mgr.14142) 215 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:29.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:28 smithi029 bash[104935]: cluster 2023-07-20T15:05:27.840349+0000 mgr.y (mgr.14142) 215 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:29.211 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:28 smithi029 bash[108361]: cluster 2023-07-20T15:05:27.840349+0000 mgr.y (mgr.14142) 215 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:31.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:30 smithi178 bash[104918]: cluster 2023-07-20T15:05:29.841047+0000 mgr.y (mgr.14142) 216 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:31.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:30 smithi029 bash[104935]: cluster 2023-07-20T15:05:29.841047+0000 mgr.y (mgr.14142) 216 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:31.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:30 smithi029 bash[108361]: cluster 2023-07-20T15:05:29.841047+0000 mgr.y (mgr.14142) 216 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:32.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:31 smithi178 bash[104918]: cluster 2023-07-20T15:05:31.841488+0000 mgr.y (mgr.14142) 217 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:32.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:31 smithi029 bash[104935]: cluster 2023-07-20T15:05:31.841488+0000 mgr.y (mgr.14142) 217 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:32.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:31 smithi029 bash[108361]: cluster 2023-07-20T15:05:31.841488+0000 mgr.y (mgr.14142) 217 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:34.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:33 smithi178 bash[104918]: cluster 2023-07-20T15:05:33.842145+0000 mgr.y (mgr.14142) 218 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:34.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:33 smithi029 bash[104935]: cluster 2023-07-20T15:05:33.842145+0000 mgr.y (mgr.14142) 218 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:34.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:33 smithi029 bash[108361]: cluster 2023-07-20T15:05:33.842145+0000 mgr.y (mgr.14142) 218 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:36.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:35 smithi178 bash[104918]: cluster 2023-07-20T15:05:35.842756+0000 mgr.y (mgr.14142) 219 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:36.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:35 smithi029 bash[104935]: cluster 2023-07-20T15:05:35.842756+0000 mgr.y (mgr.14142) 219 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:36.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:35 smithi029 bash[108361]: cluster 2023-07-20T15:05:35.842756+0000 mgr.y (mgr.14142) 219 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:38.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:37 smithi178 bash[104918]: cluster 2023-07-20T15:05:37.843434+0000 mgr.y (mgr.14142) 220 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:38.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:37 smithi029 bash[104935]: cluster 2023-07-20T15:05:37.843434+0000 mgr.y (mgr.14142) 220 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:38.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:37 smithi029 bash[108361]: cluster 2023-07-20T15:05:37.843434+0000 mgr.y (mgr.14142) 220 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:41.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:40 smithi178 bash[104918]: cluster 2023-07-20T15:05:39.844349+0000 mgr.y (mgr.14142) 221 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:41.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:40 smithi029 bash[104935]: cluster 2023-07-20T15:05:39.844349+0000 mgr.y (mgr.14142) 221 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:41.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:40 smithi029 bash[108361]: cluster 2023-07-20T15:05:39.844349+0000 mgr.y (mgr.14142) 221 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:42.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:41 smithi178 bash[104918]: cluster 2023-07-20T15:05:41.845009+0000 mgr.y (mgr.14142) 222 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:42.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:41 smithi029 bash[108361]: cluster 2023-07-20T15:05:41.845009+0000 mgr.y (mgr.14142) 222 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:42.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:41 smithi029 bash[104935]: cluster 2023-07-20T15:05:41.845009+0000 mgr.y (mgr.14142) 222 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:44.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:43 smithi178 bash[104918]: cluster 2023-07-20T15:05:43.845803+0000 mgr.y (mgr.14142) 223 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:44.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:43 smithi029 bash[108361]: cluster 2023-07-20T15:05:43.845803+0000 mgr.y (mgr.14142) 223 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:44.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:43 smithi029 bash[104935]: cluster 2023-07-20T15:05:43.845803+0000 mgr.y (mgr.14142) 223 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:46.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:45 smithi178 bash[104918]: cluster 2023-07-20T15:05:45.846271+0000 mgr.y (mgr.14142) 224 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:46.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:45 smithi029 bash[104935]: cluster 2023-07-20T15:05:45.846271+0000 mgr.y (mgr.14142) 224 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:46.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:45 smithi029 bash[108361]: cluster 2023-07-20T15:05:45.846271+0000 mgr.y (mgr.14142) 224 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:48.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:47 smithi178 bash[104918]: cluster 2023-07-20T15:05:47.846923+0000 mgr.y (mgr.14142) 225 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:48.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:47 smithi029 bash[104935]: cluster 2023-07-20T15:05:47.846923+0000 mgr.y (mgr.14142) 225 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:48.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:47 smithi029 bash[108361]: cluster 2023-07-20T15:05:47.846923+0000 mgr.y (mgr.14142) 225 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:51.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:50 smithi178 bash[104918]: cluster 2023-07-20T15:05:49.847661+0000 mgr.y (mgr.14142) 226 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:51.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:50 smithi029 bash[104935]: cluster 2023-07-20T15:05:49.847661+0000 mgr.y (mgr.14142) 226 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:51.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:50 smithi029 bash[108361]: cluster 2023-07-20T15:05:49.847661+0000 mgr.y (mgr.14142) 226 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:52.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:51 smithi178 bash[104918]: cluster 2023-07-20T15:05:51.848009+0000 mgr.y (mgr.14142) 227 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:52.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:51 smithi029 bash[104935]: cluster 2023-07-20T15:05:51.848009+0000 mgr.y (mgr.14142) 227 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:52.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:51 smithi029 bash[108361]: cluster 2023-07-20T15:05:51.848009+0000 mgr.y (mgr.14142) 227 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:54.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:53 smithi178 bash[104918]: cluster 2023-07-20T15:05:53.848748+0000 mgr.y (mgr.14142) 228 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:54.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:53 smithi029 bash[104935]: cluster 2023-07-20T15:05:53.848748+0000 mgr.y (mgr.14142) 228 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:54.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:53 smithi029 bash[108361]: cluster 2023-07-20T15:05:53.848748+0000 mgr.y (mgr.14142) 228 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:56.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:55 smithi178 bash[104918]: cluster 2023-07-20T15:05:55.849220+0000 mgr.y (mgr.14142) 229 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:56.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:55 smithi029 bash[104935]: cluster 2023-07-20T15:05:55.849220+0000 mgr.y (mgr.14142) 229 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:56.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:55 smithi029 bash[108361]: cluster 2023-07-20T15:05:55.849220+0000 mgr.y (mgr.14142) 229 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:58.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:05:57 smithi178 bash[104918]: cluster 2023-07-20T15:05:57.849679+0000 mgr.y (mgr.14142) 230 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:58.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:05:57 smithi029 bash[104935]: cluster 2023-07-20T15:05:57.849679+0000 mgr.y (mgr.14142) 230 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:05:58.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:05:57 smithi029 bash[108361]: cluster 2023-07-20T15:05:57.849679+0000 mgr.y (mgr.14142) 230 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:01.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:00 smithi178 bash[104918]: cluster 2023-07-20T15:05:59.850374+0000 mgr.y (mgr.14142) 231 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:01.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:00 smithi029 bash[104935]: cluster 2023-07-20T15:05:59.850374+0000 mgr.y (mgr.14142) 231 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:01.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:00 smithi029 bash[108361]: cluster 2023-07-20T15:05:59.850374+0000 mgr.y (mgr.14142) 231 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:02.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:01 smithi178 bash[104918]: cluster 2023-07-20T15:06:01.850792+0000 mgr.y (mgr.14142) 232 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:02.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:01 smithi029 bash[104935]: cluster 2023-07-20T15:06:01.850792+0000 mgr.y (mgr.14142) 232 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:02.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:01 smithi029 bash[108361]: cluster 2023-07-20T15:06:01.850792+0000 mgr.y (mgr.14142) 232 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:04.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:03 smithi178 bash[104918]: cluster 2023-07-20T15:06:03.851531+0000 mgr.y (mgr.14142) 233 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:04.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:03 smithi029 bash[104935]: cluster 2023-07-20T15:06:03.851531+0000 mgr.y (mgr.14142) 233 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:04.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:03 smithi029 bash[108361]: cluster 2023-07-20T15:06:03.851531+0000 mgr.y (mgr.14142) 233 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:06.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:05 smithi178 bash[104918]: cluster 2023-07-20T15:06:05.852195+0000 mgr.y (mgr.14142) 234 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:06.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:05 smithi029 bash[104935]: cluster 2023-07-20T15:06:05.852195+0000 mgr.y (mgr.14142) 234 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:06.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:05 smithi029 bash[108361]: cluster 2023-07-20T15:06:05.852195+0000 mgr.y (mgr.14142) 234 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:08.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:07 smithi178 bash[104918]: cluster 2023-07-20T15:06:07.852662+0000 mgr.y (mgr.14142) 235 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:08.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:07 smithi029 bash[104935]: cluster 2023-07-20T15:06:07.852662+0000 mgr.y (mgr.14142) 235 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:08.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:07 smithi029 bash[108361]: cluster 2023-07-20T15:06:07.852662+0000 mgr.y (mgr.14142) 235 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:11.170 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:10 smithi178 bash[104918]: cluster 2023-07-20T15:06:09.853466+0000 mgr.y (mgr.14142) 236 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:11.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:10 smithi029 bash[104935]: cluster 2023-07-20T15:06:09.853466+0000 mgr.y (mgr.14142) 236 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:11.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:10 smithi029 bash[108361]: cluster 2023-07-20T15:06:09.853466+0000 mgr.y (mgr.14142) 236 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:12.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:11 smithi178 bash[104918]: cluster 2023-07-20T15:06:11.853866+0000 mgr.y (mgr.14142) 237 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:12.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:11 smithi029 bash[104935]: cluster 2023-07-20T15:06:11.853866+0000 mgr.y (mgr.14142) 237 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:12.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:11 smithi029 bash[108361]: cluster 2023-07-20T15:06:11.853866+0000 mgr.y (mgr.14142) 237 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:14.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:13 smithi178 bash[104918]: cluster 2023-07-20T15:06:13.854467+0000 mgr.y (mgr.14142) 238 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:14.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:13 smithi029 bash[104935]: cluster 2023-07-20T15:06:13.854467+0000 mgr.y (mgr.14142) 238 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:14.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:13 smithi029 bash[108361]: cluster 2023-07-20T15:06:13.854467+0000 mgr.y (mgr.14142) 238 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:16.420 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:15 smithi178 bash[104918]: cluster 2023-07-20T15:06:15.854987+0000 mgr.y (mgr.14142) 239 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:16.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:15 smithi029 bash[104935]: cluster 2023-07-20T15:06:15.854987+0000 mgr.y (mgr.14142) 239 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:16.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:15 smithi029 bash[108361]: cluster 2023-07-20T15:06:15.854987+0000 mgr.y (mgr.14142) 239 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:18.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:17 smithi178 bash[104918]: cluster 2023-07-20T15:06:17.855670+0000 mgr.y (mgr.14142) 240 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:18.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:17 smithi029 bash[104935]: cluster 2023-07-20T15:06:17.855670+0000 mgr.y (mgr.14142) 240 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:18.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:17 smithi029 bash[108361]: cluster 2023-07-20T15:06:17.855670+0000 mgr.y (mgr.14142) 240 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:21.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:20 smithi178 bash[104918]: cluster 2023-07-20T15:06:19.856454+0000 mgr.y (mgr.14142) 241 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:21.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:20 smithi029 bash[104935]: cluster 2023-07-20T15:06:19.856454+0000 mgr.y (mgr.14142) 241 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:21.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:20 smithi029 bash[108361]: cluster 2023-07-20T15:06:19.856454+0000 mgr.y (mgr.14142) 241 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:22.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:21 smithi178 bash[104918]: cluster 2023-07-20T15:06:21.856950+0000 mgr.y (mgr.14142) 242 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:22.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:21 smithi029 bash[104935]: cluster 2023-07-20T15:06:21.856950+0000 mgr.y (mgr.14142) 242 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:22.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:21 smithi029 bash[108361]: cluster 2023-07-20T15:06:21.856950+0000 mgr.y (mgr.14142) 242 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:24.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:23 smithi178 bash[104918]: cluster 2023-07-20T15:06:23.857619+0000 mgr.y (mgr.14142) 243 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:24.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:23 smithi029 bash[104935]: cluster 2023-07-20T15:06:23.857619+0000 mgr.y (mgr.14142) 243 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:24.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:23 smithi029 bash[108361]: cluster 2023-07-20T15:06:23.857619+0000 mgr.y (mgr.14142) 243 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:26.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:25 smithi178 bash[104918]: cluster 2023-07-20T15:06:25.858317+0000 mgr.y (mgr.14142) 244 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:26.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:25 smithi029 bash[104935]: cluster 2023-07-20T15:06:25.858317+0000 mgr.y (mgr.14142) 244 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:26.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:25 smithi029 bash[108361]: cluster 2023-07-20T15:06:25.858317+0000 mgr.y (mgr.14142) 244 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:28.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:27 smithi178 bash[104918]: cluster 2023-07-20T15:06:27.858815+0000 mgr.y (mgr.14142) 245 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:28.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:27 smithi029 bash[104935]: cluster 2023-07-20T15:06:27.858815+0000 mgr.y (mgr.14142) 245 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:28.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:27 smithi029 bash[108361]: cluster 2023-07-20T15:06:27.858815+0000 mgr.y (mgr.14142) 245 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:31.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:30 smithi178 bash[104918]: cluster 2023-07-20T15:06:29.859514+0000 mgr.y (mgr.14142) 246 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:31.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:30 smithi029 bash[104935]: cluster 2023-07-20T15:06:29.859514+0000 mgr.y (mgr.14142) 246 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:31.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:30 smithi029 bash[108361]: cluster 2023-07-20T15:06:29.859514+0000 mgr.y (mgr.14142) 246 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:32.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:31 smithi178 bash[104918]: cluster 2023-07-20T15:06:31.859999+0000 mgr.y (mgr.14142) 247 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:32.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:31 smithi029 bash[104935]: cluster 2023-07-20T15:06:31.859999+0000 mgr.y (mgr.14142) 247 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:32.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:31 smithi029 bash[108361]: cluster 2023-07-20T15:06:31.859999+0000 mgr.y (mgr.14142) 247 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:34.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:33 smithi178 bash[104918]: cluster 2023-07-20T15:06:33.860578+0000 mgr.y (mgr.14142) 248 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:34.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:33 smithi029 bash[104935]: cluster 2023-07-20T15:06:33.860578+0000 mgr.y (mgr.14142) 248 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:34.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:33 smithi029 bash[108361]: cluster 2023-07-20T15:06:33.860578+0000 mgr.y (mgr.14142) 248 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:36.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:35 smithi178 bash[104918]: cluster 2023-07-20T15:06:35.861211+0000 mgr.y (mgr.14142) 249 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:36.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:35 smithi029 bash[104935]: cluster 2023-07-20T15:06:35.861211+0000 mgr.y (mgr.14142) 249 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:36.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:35 smithi029 bash[108361]: cluster 2023-07-20T15:06:35.861211+0000 mgr.y (mgr.14142) 249 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:38.298 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:37 smithi029 bash[104935]: cluster 2023-07-20T15:06:37.861757+0000 mgr.y (mgr.14142) 250 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:38.299 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:37 smithi029 bash[108361]: cluster 2023-07-20T15:06:37.861757+0000 mgr.y (mgr.14142) 250 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:38.312 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-07-20T15:06:38.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:37 smithi178 bash[104918]: cluster 2023-07-20T15:06:37.861757+0000 mgr.y (mgr.14142) 250 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:39.832 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:39 smithi029 bash[108361]: audit 2023-07-20T15:06:39.425585+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.29:0/4265617566' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2023-07-20T15:06:39.832 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:39 smithi029 bash[108361]: audit 2023-07-20T15:06:39.425871+0000 mon.a (mon.0) 787 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2023-07-20T15:06:39.833 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:39 smithi029 bash[108361]: audit 2023-07-20T15:06:39.429595+0000 mon.a (mon.0) 788 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]': finished 2023-07-20T15:06:39.833 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:39 smithi029 bash[104935]: audit 2023-07-20T15:06:39.425585+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.29:0/4265617566' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2023-07-20T15:06:39.833 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:39 smithi029 bash[104935]: audit 2023-07-20T15:06:39.425871+0000 mon.a (mon.0) 787 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2023-07-20T15:06:39.833 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:39 smithi029 bash[104935]: audit 2023-07-20T15:06:39.429595+0000 mon.a (mon.0) 788 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]': finished 2023-07-20T15:06:39.835 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-07-20T15:06:39.921 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:39 smithi178 bash[104918]: audit 2023-07-20T15:06:39.425585+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.29:0/4265617566' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2023-07-20T15:06:39.921 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:39 smithi178 bash[104918]: audit 2023-07-20T15:06:39.425871+0000 mon.a (mon.0) 787 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2023-07-20T15:06:39.921 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:39 smithi178 bash[104918]: audit 2023-07-20T15:06:39.429595+0000 mon.a (mon.0) 788 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]': finished 2023-07-20T15:06:40.951 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:40 smithi029 bash[104935]: cluster 2023-07-20T15:06:39.862319+0000 mgr.y (mgr.14142) 251 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:40.951 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:40 smithi029 bash[108361]: cluster 2023-07-20T15:06:39.862319+0000 mgr.y (mgr.14142) 251 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:41.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:40 smithi178 bash[104918]: cluster 2023-07-20T15:06:39.862319+0000 mgr.y (mgr.14142) 251 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:41.333 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2023-07-20T15:06:42.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:41 smithi178 bash[104918]: audit 2023-07-20T15:06:40.939170+0000 mon.a (mon.0) 789 : audit [INF] from='client.? 172.21.15.29:0/197549405' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2023-07-20T15:06:42.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:41 smithi178 bash[104918]: audit 2023-07-20T15:06:40.942466+0000 mon.a (mon.0) 790 : audit [INF] from='client.? 172.21.15.29:0/197549405' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]': finished 2023-07-20T15:06:42.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:41 smithi029 bash[104935]: audit 2023-07-20T15:06:40.939170+0000 mon.a (mon.0) 789 : audit [INF] from='client.? 172.21.15.29:0/197549405' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2023-07-20T15:06:42.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:41 smithi029 bash[104935]: audit 2023-07-20T15:06:40.942466+0000 mon.a (mon.0) 790 : audit [INF] from='client.? 172.21.15.29:0/197549405' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]': finished 2023-07-20T15:06:42.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:41 smithi029 bash[108361]: audit 2023-07-20T15:06:40.939170+0000 mon.a (mon.0) 789 : audit [INF] from='client.? 172.21.15.29:0/197549405' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2023-07-20T15:06:42.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:41 smithi029 bash[108361]: audit 2023-07-20T15:06:40.942466+0000 mon.a (mon.0) 790 : audit [INF] from='client.? 172.21.15.29:0/197549405' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]': finished 2023-07-20T15:06:42.457 INFO:teuthology.orchestra.run.smithi029.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec 2023-07-20T15:06:42.820 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-07-20T15:06:42.829 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi029.front.sepia.ceph.com 2023-07-20T15:06:42.830 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2023-07-20T15:06:43.060 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:42 smithi029 bash[108361]: cluster 2023-07-20T15:06:41.862595+0000 mgr.y (mgr.14142) 252 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:43.060 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:42 smithi029 bash[108361]: audit 2023-07-20T15:06:42.405738+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\"}"}]: dispatch 2023-07-20T15:06:43.060 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:42 smithi029 bash[108361]: audit 2023-07-20T15:06:42.408446+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\"}"}]': finished 2023-07-20T15:06:43.061 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:42 smithi029 bash[104935]: cluster 2023-07-20T15:06:41.862595+0000 mgr.y (mgr.14142) 252 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:43.061 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:42 smithi029 bash[104935]: audit 2023-07-20T15:06:42.405738+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\"}"}]: dispatch 2023-07-20T15:06:43.061 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:42 smithi029 bash[104935]: audit 2023-07-20T15:06:42.408446+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\"}"}]': finished 2023-07-20T15:06:43.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:42 smithi178 bash[104918]: cluster 2023-07-20T15:06:41.862595+0000 mgr.y (mgr.14142) 252 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:43.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:42 smithi178 bash[104918]: audit 2023-07-20T15:06:42.405738+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\"}"}]: dispatch 2023-07-20T15:06:43.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:42 smithi178 bash[104918]: audit 2023-07-20T15:06:42.408446+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\"}"}]': finished 2023-07-20T15:06:43.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:43 smithi029 bash[104935]: audit 2023-07-20T15:06:42.404808+0000 mgr.y (mgr.14142) 253 : audit [DBG] from='client.24637 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:06:43.951 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:43 smithi029 bash[104935]: cephadm 2023-07-20T15:06:42.410610+0000 mgr.y (mgr.14142) 254 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec 2023-07-20T15:06:43.951 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:43 smithi029 bash[108361]: audit 2023-07-20T15:06:42.404808+0000 mgr.y (mgr.14142) 253 : audit [DBG] from='client.24637 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:06:43.951 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:43 smithi029 bash[108361]: cephadm 2023-07-20T15:06:42.410610+0000 mgr.y (mgr.14142) 254 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec 2023-07-20T15:06:44.064 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-07-20T15:06:44.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:43 smithi178 bash[104918]: audit 2023-07-20T15:06:42.404808+0000 mgr.y (mgr.14142) 253 : audit [DBG] from='client.24637 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:06:44.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:43 smithi178 bash[104918]: cephadm 2023-07-20T15:06:42.410610+0000 mgr.y (mgr.14142) 254 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec 2023-07-20T15:06:44.696 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2023-07-20T15:06:44.696 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.a smithi029 running (2m) 2m ago 3m docker.io/prom/alertmanager:latest c8568f914cd2 655bfe86b45f 2023-07-20T15:06:44.697 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.a smithi178 running (2m) 2m ago 2m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c 875ebfddec5b 2023-07-20T15:06:44.697 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.x smithi178 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 851dc06637c7 2023-07-20T15:06:44.697 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.y smithi029 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 2dd3e7d75335 2023-07-20T15:06:44.697 INFO:teuthology.orchestra.run.smithi029.stdout:mon.a smithi029 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 e7fb7c490f35 2023-07-20T15:06:44.697 INFO:teuthology.orchestra.run.smithi029.stdout:mon.b smithi178 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 61793afb8d4c 2023-07-20T15:06:44.697 INFO:teuthology.orchestra.run.smithi029.stdout:mon.c smithi029 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b4038fa14c38 2023-07-20T15:06:44.698 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.a smithi029 running (3m) 2m ago 3m docker.io/prom/node-exporter:latest 458e026e6aa6 a2b5070c8a7f 2023-07-20T15:06:44.698 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.b smithi178 running (3m) 2m ago 3m docker.io/prom/node-exporter:latest 458e026e6aa6 ae43907cd0d8 2023-07-20T15:06:44.698 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (4m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a30d27a6dc87 2023-07-20T15:06:44.698 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (4m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 81d19bc55e70 2023-07-20T15:06:44.698 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (4m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d60b18f8f253 2023-07-20T15:06:44.698 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi029 running (4m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0a92a9e1f2da 2023-07-20T15:06:44.699 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi178 running (3m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b133c6a0654f 2023-07-20T15:06:44.699 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi178 running (3m) 2m ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 405b4fc27850 2023-07-20T15:06:44.699 INFO:teuthology.orchestra.run.smithi029.stdout:osd.6 smithi178 running (3m) 2m ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4311ccd86c8b 2023-07-20T15:06:44.699 INFO:teuthology.orchestra.run.smithi029.stdout:osd.7 smithi178 running (3m) 2m ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b2a3cd19518d 2023-07-20T15:06:44.699 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.a smithi178 running (2m) 2m ago 3m docker.io/prom/prometheus:latest e1fbd49323c6 d646b7313f72 2023-07-20T15:06:44.699 INFO:teuthology.orchestra.run.smithi029.stdout:rgw.r.z.smithi029.fdztmk smithi029 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 45851ddbab0f 2023-07-20T15:06:44.699 INFO:teuthology.orchestra.run.smithi029.stdout:rgw.r.z.smithi178.bnfxtc smithi178 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 653ff44a4683 2023-07-20T15:06:45.070 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-07-20T15:06:45.070 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-07-20T15:06:45.070 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2023-07-20T15:06:45.070 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:06:45.071 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-07-20T15:06:45.071 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2023-07-20T15:06:45.071 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:06:45.071 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-07-20T15:06:45.071 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2023-07-20T15:06:45.071 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:06:45.071 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": {}, 2023-07-20T15:06:45.071 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw": { 2023-07-20T15:06:45.072 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2023-07-20T15:06:45.072 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:06:45.072 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-07-20T15:06:45.072 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 15 2023-07-20T15:06:45.072 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-07-20T15:06:45.072 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-07-20T15:06:45.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:44 smithi178 bash[104918]: cluster 2023-07-20T15:06:43.863202+0000 mgr.y (mgr.14142) 255 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:45.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:44 smithi029 bash[104935]: cluster 2023-07-20T15:06:43.863202+0000 mgr.y (mgr.14142) 255 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:45.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:44 smithi029 bash[108361]: cluster 2023-07-20T15:06:43.863202+0000 mgr.y (mgr.14142) 255 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:45.389 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-07-20T15:06:45.390 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec", 2023-07-20T15:06:45.390 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-07-20T15:06:45.390 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [], 2023-07-20T15:06:45.390 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "" 2023-07-20T15:06:45.390 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-07-20T15:06:46.200 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:45 smithi029 bash[108361]: audit 2023-07-20T15:06:44.006641+0000 mgr.y (mgr.14142) 256 : audit [DBG] from='client.24643 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:06:46.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:45 smithi029 bash[108361]: audit 2023-07-20T15:06:44.330855+0000 mgr.y (mgr.14142) 257 : audit [DBG] from='client.24649 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:06:46.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:45 smithi029 bash[108361]: audit 2023-07-20T15:06:44.646195+0000 mgr.y (mgr.14142) 258 : audit [DBG] from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:06:46.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:45 smithi029 bash[108361]: audit 2023-07-20T15:06:45.023651+0000 mon.a (mon.0) 793 : audit [DBG] from='client.? 172.21.15.29:0/1182479345' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:06:46.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:45 smithi029 bash[104935]: audit 2023-07-20T15:06:44.006641+0000 mgr.y (mgr.14142) 256 : audit [DBG] from='client.24643 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:06:46.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:45 smithi029 bash[104935]: audit 2023-07-20T15:06:44.330855+0000 mgr.y (mgr.14142) 257 : audit [DBG] from='client.24649 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:06:46.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:45 smithi029 bash[104935]: audit 2023-07-20T15:06:44.646195+0000 mgr.y (mgr.14142) 258 : audit [DBG] from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:06:46.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:45 smithi029 bash[104935]: audit 2023-07-20T15:06:45.023651+0000 mon.a (mon.0) 793 : audit [DBG] from='client.? 172.21.15.29:0/1182479345' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:06:46.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:45 smithi178 bash[104918]: audit 2023-07-20T15:06:44.006641+0000 mgr.y (mgr.14142) 256 : audit [DBG] from='client.24643 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:06:46.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:45 smithi178 bash[104918]: audit 2023-07-20T15:06:44.330855+0000 mgr.y (mgr.14142) 257 : audit [DBG] from='client.24649 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:06:46.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:45 smithi178 bash[104918]: audit 2023-07-20T15:06:44.646195+0000 mgr.y (mgr.14142) 258 : audit [DBG] from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:06:46.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:45 smithi178 bash[104918]: audit 2023-07-20T15:06:45.023651+0000 mon.a (mon.0) 793 : audit [DBG] from='client.? 172.21.15.29:0/1182479345' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:06:47.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:46 smithi029 bash[104935]: audit 2023-07-20T15:06:45.343227+0000 mgr.y (mgr.14142) 259 : audit [DBG] from='client.24667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:06:47.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:46 smithi029 bash[104935]: cluster 2023-07-20T15:06:45.863576+0000 mgr.y (mgr.14142) 260 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:47.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:46 smithi029 bash[108361]: audit 2023-07-20T15:06:45.343227+0000 mgr.y (mgr.14142) 259 : audit [DBG] from='client.24667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:06:47.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:46 smithi029 bash[108361]: cluster 2023-07-20T15:06:45.863576+0000 mgr.y (mgr.14142) 260 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:47.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:46 smithi178 bash[104918]: audit 2023-07-20T15:06:45.343227+0000 mgr.y (mgr.14142) 259 : audit [DBG] from='client.24667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:06:47.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:46 smithi178 bash[104918]: cluster 2023-07-20T15:06:45.863576+0000 mgr.y (mgr.14142) 260 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:48.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:47 smithi029 bash[104935]: cluster 2023-07-20T15:06:47.863916+0000 mgr.y (mgr.14142) 261 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:48.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:47 smithi029 bash[108361]: cluster 2023-07-20T15:06:47.863916+0000 mgr.y (mgr.14142) 261 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:48.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:47 smithi178 bash[104918]: cluster 2023-07-20T15:06:47.863916+0000 mgr.y (mgr.14142) 261 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:51.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:50 smithi178 bash[104918]: cluster 2023-07-20T15:06:49.864462+0000 mgr.y (mgr.14142) 262 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:51.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:50 smithi029 bash[104935]: cluster 2023-07-20T15:06:49.864462+0000 mgr.y (mgr.14142) 262 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:51.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:50 smithi029 bash[108361]: cluster 2023-07-20T15:06:49.864462+0000 mgr.y (mgr.14142) 262 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:52.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:51 smithi178 bash[104918]: cluster 2023-07-20T15:06:51.864759+0000 mgr.y (mgr.14142) 263 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:52.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:51 smithi029 bash[104935]: cluster 2023-07-20T15:06:51.864759+0000 mgr.y (mgr.14142) 263 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:52.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:51 smithi029 bash[108361]: cluster 2023-07-20T15:06:51.864759+0000 mgr.y (mgr.14142) 263 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:54.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:53 smithi178 bash[104918]: cluster 2023-07-20T15:06:53.865280+0000 mgr.y (mgr.14142) 264 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:54.450 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:53 smithi029 bash[108361]: cluster 2023-07-20T15:06:53.865280+0000 mgr.y (mgr.14142) 264 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:54.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:53 smithi029 bash[104935]: cluster 2023-07-20T15:06:53.865280+0000 mgr.y (mgr.14142) 264 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:56.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:55 smithi178 bash[104918]: cluster 2023-07-20T15:06:55.865650+0000 mgr.y (mgr.14142) 265 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:56.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:55 smithi029 bash[104935]: cluster 2023-07-20T15:06:55.865650+0000 mgr.y (mgr.14142) 265 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:56.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:55 smithi029 bash[108361]: cluster 2023-07-20T15:06:55.865650+0000 mgr.y (mgr.14142) 265 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:58.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:06:57 smithi178 bash[104918]: cluster 2023-07-20T15:06:57.866031+0000 mgr.y (mgr.14142) 266 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:58.450 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:06:57 smithi029 bash[104935]: cluster 2023-07-20T15:06:57.866031+0000 mgr.y (mgr.14142) 266 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:06:58.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:06:57 smithi029 bash[108361]: cluster 2023-07-20T15:06:57.866031+0000 mgr.y (mgr.14142) 266 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:01.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:00 smithi178 bash[104918]: cluster 2023-07-20T15:06:59.866564+0000 mgr.y (mgr.14142) 267 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:01.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:00 smithi029 bash[104935]: cluster 2023-07-20T15:06:59.866564+0000 mgr.y (mgr.14142) 267 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:01.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:00 smithi029 bash[108361]: cluster 2023-07-20T15:06:59.866564+0000 mgr.y (mgr.14142) 267 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:02.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:01 smithi178 bash[104918]: cluster 2023-07-20T15:07:01.866985+0000 mgr.y (mgr.14142) 268 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:02.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:01 smithi029 bash[104935]: cluster 2023-07-20T15:07:01.866985+0000 mgr.y (mgr.14142) 268 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:02.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:01 smithi029 bash[108361]: cluster 2023-07-20T15:07:01.866985+0000 mgr.y (mgr.14142) 268 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:04.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:03 smithi178 bash[104918]: cluster 2023-07-20T15:07:03.867559+0000 mgr.y (mgr.14142) 269 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:04.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:03 smithi029 bash[104935]: cluster 2023-07-20T15:07:03.867559+0000 mgr.y (mgr.14142) 269 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:04.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:03 smithi029 bash[108361]: cluster 2023-07-20T15:07:03.867559+0000 mgr.y (mgr.14142) 269 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:06.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:05 smithi178 bash[104918]: cluster 2023-07-20T15:07:05.867960+0000 mgr.y (mgr.14142) 270 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:06.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:05 smithi029 bash[104935]: cluster 2023-07-20T15:07:05.867960+0000 mgr.y (mgr.14142) 270 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:06.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:05 smithi029 bash[108361]: cluster 2023-07-20T15:07:05.867960+0000 mgr.y (mgr.14142) 270 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:08.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:07 smithi178 bash[104918]: cluster 2023-07-20T15:07:07.868397+0000 mgr.y (mgr.14142) 271 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:08.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:07 smithi029 bash[104935]: cluster 2023-07-20T15:07:07.868397+0000 mgr.y (mgr.14142) 271 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:08.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:07 smithi029 bash[108361]: cluster 2023-07-20T15:07:07.868397+0000 mgr.y (mgr.14142) 271 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:09.921 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:09 smithi178 bash[104918]: audit 2023-07-20T15:07:09.533438+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\", \"target_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"target_version\": \"ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)\"}"}]: dispatch 2023-07-20T15:07:09.921 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:09 smithi178 bash[104918]: audit 2023-07-20T15:07:09.536121+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\", \"target_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"target_version\": \"ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)\"}"}]': finished 2023-07-20T15:07:09.922 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:09 smithi178 bash[104918]: audit 2023-07-20T15:07:09.536632+0000 mon.a (mon.0) 796 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:07:09.926 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:09 smithi029 bash[104935]: audit 2023-07-20T15:07:09.533438+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\", \"target_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"target_version\": \"ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)\"}"}]: dispatch 2023-07-20T15:07:09.926 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:09 smithi029 bash[104935]: audit 2023-07-20T15:07:09.536121+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\", \"target_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"target_version\": \"ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)\"}"}]': finished 2023-07-20T15:07:09.926 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:09 smithi029 bash[104935]: audit 2023-07-20T15:07:09.536632+0000 mon.a (mon.0) 796 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:07:09.926 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:09 smithi029 bash[108361]: audit 2023-07-20T15:07:09.533438+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\", \"target_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"target_version\": \"ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)\"}"}]: dispatch 2023-07-20T15:07:09.927 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:09 smithi029 bash[108361]: audit 2023-07-20T15:07:09.536121+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\", \"target_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"target_version\": \"ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)\"}"}]': finished 2023-07-20T15:07:09.927 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:09 smithi029 bash[108361]: audit 2023-07-20T15:07:09.536632+0000 mon.a (mon.0) 796 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:07:11.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:10 smithi178 bash[104918]: cephadm 2023-07-20T15:07:09.536434+0000 mgr.y (mgr.14142) 272 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec with id 247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f 2023-07-20T15:07:11.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:10 smithi178 bash[104918]: cephadm 2023-07-20T15:07:09.537358+0000 mgr.y (mgr.14142) 273 : cephadm [INF] Upgrade: Checking mgr daemons... 2023-07-20T15:07:11.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:10 smithi178 bash[104918]: cephadm 2023-07-20T15:07:09.537535+0000 mgr.y (mgr.14142) 274 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2023-07-20T15:07:11.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:10 smithi178 bash[104918]: cephadm 2023-07-20T15:07:09.751032+0000 mgr.y (mgr.14142) 275 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec on smithi178 2023-07-20T15:07:11.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:10 smithi178 bash[104918]: cluster 2023-07-20T15:07:09.868971+0000 mgr.y (mgr.14142) 276 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:11.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:10 smithi029 bash[104935]: cephadm 2023-07-20T15:07:09.536434+0000 mgr.y (mgr.14142) 272 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec with id 247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f 2023-07-20T15:07:11.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:10 smithi029 bash[104935]: cephadm 2023-07-20T15:07:09.537358+0000 mgr.y (mgr.14142) 273 : cephadm [INF] Upgrade: Checking mgr daemons... 2023-07-20T15:07:11.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:10 smithi029 bash[104935]: cephadm 2023-07-20T15:07:09.537535+0000 mgr.y (mgr.14142) 274 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2023-07-20T15:07:11.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:10 smithi029 bash[104935]: cephadm 2023-07-20T15:07:09.751032+0000 mgr.y (mgr.14142) 275 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec on smithi178 2023-07-20T15:07:11.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:10 smithi029 bash[104935]: cluster 2023-07-20T15:07:09.868971+0000 mgr.y (mgr.14142) 276 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:11.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:10 smithi029 bash[108361]: cephadm 2023-07-20T15:07:09.536434+0000 mgr.y (mgr.14142) 272 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec with id 247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f 2023-07-20T15:07:11.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:10 smithi029 bash[108361]: cephadm 2023-07-20T15:07:09.537358+0000 mgr.y (mgr.14142) 273 : cephadm [INF] Upgrade: Checking mgr daemons... 2023-07-20T15:07:11.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:10 smithi029 bash[108361]: cephadm 2023-07-20T15:07:09.537535+0000 mgr.y (mgr.14142) 274 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2023-07-20T15:07:11.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:10 smithi029 bash[108361]: cephadm 2023-07-20T15:07:09.751032+0000 mgr.y (mgr.14142) 275 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec on smithi178 2023-07-20T15:07:11.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:10 smithi029 bash[108361]: cluster 2023-07-20T15:07:09.868971+0000 mgr.y (mgr.14142) 276 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:12.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:11 smithi178 bash[104918]: cluster 2023-07-20T15:07:11.869481+0000 mgr.y (mgr.14142) 277 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:12.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:11 smithi029 bash[104935]: cluster 2023-07-20T15:07:11.869481+0000 mgr.y (mgr.14142) 277 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:12.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:11 smithi029 bash[108361]: cluster 2023-07-20T15:07:11.869481+0000 mgr.y (mgr.14142) 277 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:14.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:13 smithi178 bash[104918]: cluster 2023-07-20T15:07:13.870344+0000 mgr.y (mgr.14142) 278 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:14.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:13 smithi029 bash[104935]: cluster 2023-07-20T15:07:13.870344+0000 mgr.y (mgr.14142) 278 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:14.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:13 smithi029 bash[108361]: cluster 2023-07-20T15:07:13.870344+0000 mgr.y (mgr.14142) 278 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:15.702 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-07-20T15:07:16.262 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2023-07-20T15:07:16.263 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.a smithi029 running (3m) 2m ago 3m docker.io/prom/alertmanager:latest c8568f914cd2 655bfe86b45f 2023-07-20T15:07:16.263 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.a smithi178 running (3m) 2m ago 3m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c 875ebfddec5b 2023-07-20T15:07:16.263 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.x smithi178 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 851dc06637c7 2023-07-20T15:07:16.263 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.y smithi029 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 2dd3e7d75335 2023-07-20T15:07:16.264 INFO:teuthology.orchestra.run.smithi029.stdout:mon.a smithi029 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 e7fb7c490f35 2023-07-20T15:07:16.265 INFO:teuthology.orchestra.run.smithi029.stdout:mon.b smithi178 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 61793afb8d4c 2023-07-20T15:07:16.265 INFO:teuthology.orchestra.run.smithi029.stdout:mon.c smithi029 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b4038fa14c38 2023-07-20T15:07:16.265 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.a smithi029 running (3m) 2m ago 3m docker.io/prom/node-exporter:latest 458e026e6aa6 a2b5070c8a7f 2023-07-20T15:07:16.265 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.b smithi178 running (3m) 2m ago 3m docker.io/prom/node-exporter:latest 458e026e6aa6 ae43907cd0d8 2023-07-20T15:07:16.266 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a30d27a6dc87 2023-07-20T15:07:16.266 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 81d19bc55e70 2023-07-20T15:07:16.266 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (4m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d60b18f8f253 2023-07-20T15:07:16.266 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi029 running (4m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0a92a9e1f2da 2023-07-20T15:07:16.267 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi178 running (4m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b133c6a0654f 2023-07-20T15:07:16.267 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi178 running (4m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 405b4fc27850 2023-07-20T15:07:16.267 INFO:teuthology.orchestra.run.smithi029.stdout:osd.6 smithi178 running (3m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4311ccd86c8b 2023-07-20T15:07:16.267 INFO:teuthology.orchestra.run.smithi029.stdout:osd.7 smithi178 running (3m) 2m ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b2a3cd19518d 2023-07-20T15:07:16.268 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.a smithi178 running (3m) 2m ago 3m docker.io/prom/prometheus:latest e1fbd49323c6 d646b7313f72 2023-07-20T15:07:16.268 INFO:teuthology.orchestra.run.smithi029.stdout:rgw.r.z.smithi029.fdztmk smithi029 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 45851ddbab0f 2023-07-20T15:07:16.268 INFO:teuthology.orchestra.run.smithi029.stdout:rgw.r.z.smithi178.bnfxtc smithi178 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 653ff44a4683 2023-07-20T15:07:16.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:15 smithi178 bash[104918]: audit 2023-07-20T15:07:15.644768+0000 mgr.y (mgr.14142) 279 : audit [DBG] from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:16.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:15 smithi178 bash[104918]: cluster 2023-07-20T15:07:15.870694+0000 mgr.y (mgr.14142) 280 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:16.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:15 smithi029 bash[104935]: audit 2023-07-20T15:07:15.644768+0000 mgr.y (mgr.14142) 279 : audit [DBG] from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:16.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:15 smithi029 bash[104935]: cluster 2023-07-20T15:07:15.870694+0000 mgr.y (mgr.14142) 280 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:16.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:15 smithi029 bash[108361]: audit 2023-07-20T15:07:15.644768+0000 mgr.y (mgr.14142) 279 : audit [DBG] from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:16.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:15 smithi029 bash[108361]: cluster 2023-07-20T15:07:15.870694+0000 mgr.y (mgr.14142) 280 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:16.565 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-07-20T15:07:16.565 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-07-20T15:07:16.565 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2023-07-20T15:07:16.565 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:07:16.565 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-07-20T15:07:16.565 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2023-07-20T15:07:16.566 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:07:16.566 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-07-20T15:07:16.566 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2023-07-20T15:07:16.566 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:07:16.566 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": {}, 2023-07-20T15:07:16.566 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw": { 2023-07-20T15:07:16.566 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2023-07-20T15:07:16.566 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:07:16.567 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-07-20T15:07:16.567 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 15 2023-07-20T15:07:16.567 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-07-20T15:07:16.567 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-07-20T15:07:16.849 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-07-20T15:07:16.850 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec", 2023-07-20T15:07:16.850 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-07-20T15:07:16.850 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [], 2023-07-20T15:07:16.850 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "" 2023-07-20T15:07:16.851 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-07-20T15:07:17.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:16 smithi178 bash[104918]: audit 2023-07-20T15:07:15.936921+0000 mgr.y (mgr.14142) 281 : audit [DBG] from='client.24679 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:17.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:16 smithi178 bash[104918]: audit 2023-07-20T15:07:16.212218+0000 mgr.y (mgr.14142) 282 : audit [DBG] from='client.24685 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:17.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:16 smithi178 bash[104918]: audit 2023-07-20T15:07:16.518428+0000 mon.c (mon.1) 37 : audit [DBG] from='client.? 172.21.15.29:0/3249718907' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:07:17.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:16 smithi178 bash[104918]: audit 2023-07-20T15:07:16.802969+0000 mgr.y (mgr.14142) 283 : audit [DBG] from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:17.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:16 smithi029 bash[104935]: audit 2023-07-20T15:07:15.936921+0000 mgr.y (mgr.14142) 281 : audit [DBG] from='client.24679 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:17.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:16 smithi029 bash[104935]: audit 2023-07-20T15:07:16.212218+0000 mgr.y (mgr.14142) 282 : audit [DBG] from='client.24685 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:17.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:16 smithi029 bash[104935]: audit 2023-07-20T15:07:16.518428+0000 mon.c (mon.1) 37 : audit [DBG] from='client.? 172.21.15.29:0/3249718907' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:07:17.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:16 smithi029 bash[104935]: audit 2023-07-20T15:07:16.802969+0000 mgr.y (mgr.14142) 283 : audit [DBG] from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:17.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:16 smithi029 bash[108361]: audit 2023-07-20T15:07:15.936921+0000 mgr.y (mgr.14142) 281 : audit [DBG] from='client.24679 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:17.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:16 smithi029 bash[108361]: audit 2023-07-20T15:07:16.212218+0000 mgr.y (mgr.14142) 282 : audit [DBG] from='client.24685 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:17.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:16 smithi029 bash[108361]: audit 2023-07-20T15:07:16.518428+0000 mon.c (mon.1) 37 : audit [DBG] from='client.? 172.21.15.29:0/3249718907' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:07:17.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:16 smithi029 bash[108361]: audit 2023-07-20T15:07:16.802969+0000 mgr.y (mgr.14142) 283 : audit [DBG] from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:18.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:17 smithi178 bash[104918]: cluster 2023-07-20T15:07:17.871330+0000 mgr.y (mgr.14142) 284 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:18.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:17 smithi029 bash[104935]: cluster 2023-07-20T15:07:17.871330+0000 mgr.y (mgr.14142) 284 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:18.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:17 smithi029 bash[108361]: cluster 2023-07-20T15:07:17.871330+0000 mgr.y (mgr.14142) 284 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:21.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:20 smithi178 bash[104918]: cluster 2023-07-20T15:07:19.872274+0000 mgr.y (mgr.14142) 285 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:21.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:20 smithi029 bash[104935]: cluster 2023-07-20T15:07:19.872274+0000 mgr.y (mgr.14142) 285 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:21.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:20 smithi029 bash[108361]: cluster 2023-07-20T15:07:19.872274+0000 mgr.y (mgr.14142) 285 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:22.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:21 smithi178 bash[104918]: cluster 2023-07-20T15:07:21.872718+0000 mgr.y (mgr.14142) 286 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:22.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:21 smithi029 bash[104935]: cluster 2023-07-20T15:07:21.872718+0000 mgr.y (mgr.14142) 286 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:22.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:21 smithi029 bash[108361]: cluster 2023-07-20T15:07:21.872718+0000 mgr.y (mgr.14142) 286 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:24.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:23 smithi178 bash[104918]: cluster 2023-07-20T15:07:23.873357+0000 mgr.y (mgr.14142) 287 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:24.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:23 smithi029 bash[104935]: cluster 2023-07-20T15:07:23.873357+0000 mgr.y (mgr.14142) 287 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:24.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:23 smithi029 bash[108361]: cluster 2023-07-20T15:07:23.873357+0000 mgr.y (mgr.14142) 287 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:26.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:25 smithi178 bash[104918]: cluster 2023-07-20T15:07:25.874044+0000 mgr.y (mgr.14142) 288 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:26.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:25 smithi029 bash[104935]: cluster 2023-07-20T15:07:25.874044+0000 mgr.y (mgr.14142) 288 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:26.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:25 smithi029 bash[108361]: cluster 2023-07-20T15:07:25.874044+0000 mgr.y (mgr.14142) 288 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:28.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:27 smithi178 bash[104918]: cluster 2023-07-20T15:07:27.874544+0000 mgr.y (mgr.14142) 289 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:28.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:27 smithi029 bash[104935]: cluster 2023-07-20T15:07:27.874544+0000 mgr.y (mgr.14142) 289 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:28.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:27 smithi029 bash[108361]: cluster 2023-07-20T15:07:27.874544+0000 mgr.y (mgr.14142) 289 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:31.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:30 smithi178 bash[104918]: cluster 2023-07-20T15:07:29.875341+0000 mgr.y (mgr.14142) 290 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:31.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:30 smithi029 bash[104935]: cluster 2023-07-20T15:07:29.875341+0000 mgr.y (mgr.14142) 290 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:31.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:30 smithi029 bash[108361]: cluster 2023-07-20T15:07:29.875341+0000 mgr.y (mgr.14142) 290 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:32.384 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:31 smithi178 bash[104918]: cluster 2023-07-20T15:07:31.875907+0000 mgr.y (mgr.14142) 291 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:32.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:31 smithi029 bash[104935]: cluster 2023-07-20T15:07:31.875907+0000 mgr.y (mgr.14142) 291 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:32.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:31 smithi029 bash[108361]: cluster 2023-07-20T15:07:31.875907+0000 mgr.y (mgr.14142) 291 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:33.247 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:32 smithi178 bash[104918]: cephadm 2023-07-20T15:07:32.713729+0000 mgr.y (mgr.14142) 292 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2023-07-20T15:07:33.247 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:32 smithi178 bash[104918]: cephadm 2023-07-20T15:07:32.713831+0000 mgr.y (mgr.14142) 293 : cephadm [INF] Upgrade: Redeploying mgr.x 2023-07-20T15:07:33.247 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:32 smithi178 bash[104918]: audit 2023-07-20T15:07:32.714268+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec", "who": "mgr.x"}]: dispatch 2023-07-20T15:07:33.247 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:32 smithi178 bash[104918]: audit 2023-07-20T15:07:32.720358+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec", "who": "mgr.x"}]': finished 2023-07-20T15:07:33.247 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:32 smithi178 bash[104918]: audit 2023-07-20T15:07:32.721289+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2023-07-20T15:07:33.248 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:32 smithi178 bash[104918]: audit 2023-07-20T15:07:32.722071+0000 mon.a (mon.0) 800 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:07:33.248 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:32 smithi178 bash[104918]: cephadm 2023-07-20T15:07:32.722683+0000 mgr.y (mgr.14142) 294 : cephadm [INF] Deploying daemon mgr.x on smithi178 2023-07-20T15:07:33.248 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:32 smithi178 bash[104918]: audit 2023-07-20T15:07:32.722977+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2023-07-20T15:07:33.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:32 smithi029 bash[108361]: cephadm 2023-07-20T15:07:32.713729+0000 mgr.y (mgr.14142) 292 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2023-07-20T15:07:33.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:32 smithi029 bash[108361]: cephadm 2023-07-20T15:07:32.713831+0000 mgr.y (mgr.14142) 293 : cephadm [INF] Upgrade: Redeploying mgr.x 2023-07-20T15:07:33.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:32 smithi029 bash[108361]: audit 2023-07-20T15:07:32.714268+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec", "who": "mgr.x"}]: dispatch 2023-07-20T15:07:33.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:32 smithi029 bash[108361]: audit 2023-07-20T15:07:32.720358+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec", "who": "mgr.x"}]': finished 2023-07-20T15:07:33.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:32 smithi029 bash[108361]: audit 2023-07-20T15:07:32.721289+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2023-07-20T15:07:33.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:32 smithi029 bash[108361]: audit 2023-07-20T15:07:32.722071+0000 mon.a (mon.0) 800 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:07:33.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:32 smithi029 bash[108361]: cephadm 2023-07-20T15:07:32.722683+0000 mgr.y (mgr.14142) 294 : cephadm [INF] Deploying daemon mgr.x on smithi178 2023-07-20T15:07:33.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:32 smithi029 bash[108361]: audit 2023-07-20T15:07:32.722977+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2023-07-20T15:07:33.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:32 smithi029 bash[104935]: cephadm 2023-07-20T15:07:32.713729+0000 mgr.y (mgr.14142) 292 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2023-07-20T15:07:33.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:32 smithi029 bash[104935]: cephadm 2023-07-20T15:07:32.713831+0000 mgr.y (mgr.14142) 293 : cephadm [INF] Upgrade: Redeploying mgr.x 2023-07-20T15:07:33.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:32 smithi029 bash[104935]: audit 2023-07-20T15:07:32.714268+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec", "who": "mgr.x"}]: dispatch 2023-07-20T15:07:33.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:32 smithi029 bash[104935]: audit 2023-07-20T15:07:32.720358+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec", "who": "mgr.x"}]': finished 2023-07-20T15:07:33.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:32 smithi029 bash[104935]: audit 2023-07-20T15:07:32.721289+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2023-07-20T15:07:33.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:32 smithi029 bash[104935]: audit 2023-07-20T15:07:32.722071+0000 mon.a (mon.0) 800 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:07:33.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:32 smithi029 bash[104935]: cephadm 2023-07-20T15:07:32.722683+0000 mgr.y (mgr.14142) 294 : cephadm [INF] Deploying daemon mgr.x on smithi178 2023-07-20T15:07:33.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:32 smithi029 bash[104935]: audit 2023-07-20T15:07:32.722977+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2023-07-20T15:07:33.921 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:33 smithi178 systemd[1]: Stopping Ceph mgr.x for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:07:34.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:33 smithi178 bash[104918]: cluster 2023-07-20T15:07:33.876772+0000 mgr.y (mgr.14142) 295 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:34.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:33 smithi029 bash[104935]: cluster 2023-07-20T15:07:33.876772+0000 mgr.y (mgr.14142) 295 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:34.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:33 smithi029 bash[108361]: cluster 2023-07-20T15:07:33.876772+0000 mgr.y (mgr.14142) 295 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:36.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:35 smithi178 bash[104918]: cluster 2023-07-20T15:07:35.877361+0000 mgr.y (mgr.14142) 296 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:36.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:35 smithi029 bash[104935]: cluster 2023-07-20T15:07:35.877361+0000 mgr.y (mgr.14142) 296 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:36.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:35 smithi029 bash[108361]: cluster 2023-07-20T15:07:35.877361+0000 mgr.y (mgr.14142) 296 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:38.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:37 smithi178 bash[104918]: cluster 2023-07-20T15:07:37.877999+0000 mgr.y (mgr.14142) 297 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:38.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:37 smithi029 bash[104935]: cluster 2023-07-20T15:07:37.877999+0000 mgr.y (mgr.14142) 297 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:38.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:37 smithi029 bash[108361]: cluster 2023-07-20T15:07:37.877999+0000 mgr.y (mgr.14142) 297 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:42.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:41 smithi178 bash[104918]: cluster 2023-07-20T15:07:39.878663+0000 mgr.y (mgr.14142) 298 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:42.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:41 smithi029 bash[104935]: cluster 2023-07-20T15:07:39.878663+0000 mgr.y (mgr.14142) 298 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:42.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:41 smithi029 bash[108361]: cluster 2023-07-20T15:07:39.878663+0000 mgr.y (mgr.14142) 298 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:44.069 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:43 smithi178 bash[104918]: cluster 2023-07-20T15:07:41.879095+0000 mgr.y (mgr.14142) 299 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:44.069 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:43 smithi178 podman[119414]: time="2023-07-20T15:07:43Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr.x in 10 seconds, resorting to SIGKILL" 2023-07-20T15:07:44.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:43 smithi029 bash[104935]: cluster 2023-07-20T15:07:41.879095+0000 mgr.y (mgr.14142) 299 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:44.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:43 smithi029 bash[108361]: cluster 2023-07-20T15:07:41.879095+0000 mgr.y (mgr.14142) 299 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:44.323 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:44 smithi178 podman[119414]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr.x 2023-07-20T15:07:44.324 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:44 smithi178 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.x.service: Main process exited, code=exited, status=137/n/a 2023-07-20T15:07:44.324 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:44 smithi178 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.x.service: Failed with result 'exit-code'. 2023-07-20T15:07:44.324 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:44 smithi178 systemd[1]: Stopped Ceph mgr.x for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:07:44.671 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:44 smithi178 systemd[1]: Starting Ceph mgr.x for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:07:44.672 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:44 smithi178 podman[119490]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr.x" found: no such container 2023-07-20T15:07:44.672 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:44 smithi178 systemd[1]: Started Ceph mgr.x for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:07:45.119 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:44 smithi178 bash[119506]: debug 2023-07-20T15:07:44.640+0000 7f8a8108c700 1 -- 172.21.15.178:0/1554181295 <== mon.2 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a0af08c4e0 con 0x55a0af063000 2023-07-20T15:07:45.119 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:44 smithi178 bash[119506]: debug 2023-07-20T15:07:44.774+0000 7f8a91672680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T15:07:45.119 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:44 smithi178 bash[119506]: debug 2023-07-20T15:07:44.859+0000 7f8a91672680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T15:07:45.120 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:44 smithi178 bash[104918]: audit 2023-07-20T15:07:44.338880+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758220\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758377\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758414\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758450\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758487\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758523\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758559\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758595\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758654\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:07:45.120 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:44 smithi178 bash[104918]: audit 2023-07-20T15:07:44.343016+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758220\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758377\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758414\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758450\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758487\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758523\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758559\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758595\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758654\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:07:45.121 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:44 smithi178 bash[104918]: audit 2023-07-20T15:07:44.343940+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:07:45.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:44 smithi029 bash[104935]: audit 2023-07-20T15:07:44.338880+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758220\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758377\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758414\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758450\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758487\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758523\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758559\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758595\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758654\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:07:45.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:44 smithi029 bash[108361]: audit 2023-07-20T15:07:44.338880+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758220\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758377\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758414\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758450\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758487\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758523\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758559\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758595\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758654\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:07:45.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:44 smithi029 bash[108361]: audit 2023-07-20T15:07:44.343016+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758220\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758377\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758414\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758450\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758487\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758523\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758559\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758595\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758654\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:07:45.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:44 smithi029 bash[108361]: audit 2023-07-20T15:07:44.343940+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:07:45.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:44 smithi029 bash[104935]: audit 2023-07-20T15:07:44.343016+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758220\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758377\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758414\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758450\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758487\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758523\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758559\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758595\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:04:42.758654\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:07:45.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:44 smithi029 bash[104935]: audit 2023-07-20T15:07:44.343940+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2023-07-20T15:07:45.421 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:45 smithi178 bash[119506]: debug 2023-07-20T15:07:45.259+0000 7f8a91672680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T15:07:46.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:45 smithi029 bash[104935]: cluster 2023-07-20T15:07:43.879893+0000 mgr.y (mgr.14142) 300 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:46.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:45 smithi029 bash[108361]: cluster 2023-07-20T15:07:43.879893+0000 mgr.y (mgr.14142) 300 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:46.232 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:45 smithi178 bash[104918]: cluster 2023-07-20T15:07:43.879893+0000 mgr.y (mgr.14142) 300 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:46.233 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:46 smithi178 bash[119506]: debug 2023-07-20T15:07:46.095+0000 7f8a91672680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T15:07:46.233 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:46 smithi178 bash[119506]: debug 2023-07-20T15:07:46.183+0000 7f8a91672680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T15:07:46.652 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:46 smithi178 bash[119506]: debug 2023-07-20T15:07:46.417+0000 7f8a91672680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T15:07:47.161 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-07-20T15:07:47.716 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2023-07-20T15:07:47.716 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.a smithi029 running (3m) 3m ago 4m docker.io/prom/alertmanager:latest c8568f914cd2 655bfe86b45f 2023-07-20T15:07:47.717 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.a smithi178 running (3m) 0s ago 3m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c 875ebfddec5b 2023-07-20T15:07:47.717 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.x smithi178 running (3s) 0s ago 6m 16.2.13-355-ge2018073 quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec 247668761b27 420b4f2e7f78 2023-07-20T15:07:47.717 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.y smithi029 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 2dd3e7d75335 2023-07-20T15:07:47.717 INFO:teuthology.orchestra.run.smithi029.stdout:mon.a smithi029 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 e7fb7c490f35 2023-07-20T15:07:47.717 INFO:teuthology.orchestra.run.smithi029.stdout:mon.b smithi178 running (6m) 0s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 61793afb8d4c 2023-07-20T15:07:47.717 INFO:teuthology.orchestra.run.smithi029.stdout:mon.c smithi029 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b4038fa14c38 2023-07-20T15:07:47.718 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.a smithi029 running (4m) 3m ago 4m docker.io/prom/node-exporter:latest 458e026e6aa6 a2b5070c8a7f 2023-07-20T15:07:47.718 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.b smithi178 running (4m) 0s ago 4m docker.io/prom/node-exporter:latest 458e026e6aa6 ae43907cd0d8 2023-07-20T15:07:47.718 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (5m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a30d27a6dc87 2023-07-20T15:07:47.718 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (5m) 3m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 81d19bc55e70 2023-07-20T15:07:47.718 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (5m) 3m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d60b18f8f253 2023-07-20T15:07:47.718 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi029 running (5m) 3m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0a92a9e1f2da 2023-07-20T15:07:47.718 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi178 running (5m) 0s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b133c6a0654f 2023-07-20T15:07:47.718 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi178 running (4m) 0s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 405b4fc27850 2023-07-20T15:07:47.719 INFO:teuthology.orchestra.run.smithi029.stdout:osd.6 smithi178 running (4m) 0s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4311ccd86c8b 2023-07-20T15:07:47.719 INFO:teuthology.orchestra.run.smithi029.stdout:osd.7 smithi178 running (4m) 0s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b2a3cd19518d 2023-07-20T15:07:47.719 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.a smithi178 running (3m) 0s ago 4m docker.io/prom/prometheus:latest e1fbd49323c6 d646b7313f72 2023-07-20T15:07:47.719 INFO:teuthology.orchestra.run.smithi029.stdout:rgw.r.z.smithi029.fdztmk smithi029 running (3m) 3m ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 45851ddbab0f 2023-07-20T15:07:47.720 INFO:teuthology.orchestra.run.smithi029.stdout:rgw.r.z.smithi178.bnfxtc smithi178 running (3m) 0s ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 653ff44a4683 2023-07-20T15:07:47.773 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:47 smithi178 bash[119506]: debug 2023-07-20T15:07:47.425+0000 7f8a91672680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T15:07:47.773 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:47 smithi178 bash[119506]: debug 2023-07-20T15:07:47.554+0000 7f8a91672680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T15:07:47.774 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:47 smithi178 bash[119506]: debug 2023-07-20T15:07:47.634+0000 7f8a91672680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T15:07:48.026 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-07-20T15:07:48.026 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-07-20T15:07:48.027 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2023-07-20T15:07:48.027 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:07:48.027 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-07-20T15:07:48.027 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2023-07-20T15:07:48.027 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:07:48.027 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-07-20T15:07:48.027 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2023-07-20T15:07:48.028 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:07:48.028 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": {}, 2023-07-20T15:07:48.028 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw": { 2023-07-20T15:07:48.028 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2023-07-20T15:07:48.028 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:07:48.028 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-07-20T15:07:48.028 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 15 2023-07-20T15:07:48.029 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-07-20T15:07:48.029 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-07-20T15:07:48.104 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:47 smithi178 bash[119506]: debug 2023-07-20T15:07:47.724+0000 7f8a91672680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T15:07:48.104 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:47 smithi178 bash[119506]: debug 2023-07-20T15:07:47.923+0000 7f8a91672680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T15:07:48.105 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:47 smithi178 bash[104918]: cluster 2023-07-20T15:07:45.880323+0000 mgr.y (mgr.14142) 301 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:48.105 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:47 smithi178 bash[104918]: audit 2023-07-20T15:07:47.026534+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025221\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025303\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:07:44.340778\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025338\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025369\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025398\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025428\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025458\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025489\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025518\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025547\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_daemon_update\": \"2023-07-20T15:07:47.025631\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:07:48.105 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:47 smithi178 bash[104918]: audit 2023-07-20T15:07:47.029357+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025221\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025303\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:07:44.340778\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025338\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025369\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025398\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025428\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025458\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025489\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025518\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025547\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_daemon_update\": \"2023-07-20T15:07:47.025631\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:07:48.106 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:47 smithi178 bash[104918]: audit 2023-07-20T15:07:47.031334+0000 mon.a (mon.0) 807 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:07:48.106 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:47 smithi178 bash[104918]: audit 2023-07-20T15:07:47.034133+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2023-07-20T15:07:48.106 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:47 smithi178 bash[104918]: cluster 2023-07-20T15:07:47.037741+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2023-07-20T15:07:48.106 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:47 smithi178 bash[104918]: cluster 2023-07-20T15:07:47.847042+0000 mon.a (mon.0) 810 : cluster [DBG] Standby manager daemon y started 2023-07-20T15:07:48.201 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[105170]: ignoring --setuser ceph since I am not root 2023-07-20T15:07:48.201 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[105170]: ignoring --setgroup ceph since I am not root 2023-07-20T15:07:48.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:47 smithi029 bash[108361]: cluster 2023-07-20T15:07:45.880323+0000 mgr.y (mgr.14142) 301 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:48.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:47 smithi029 bash[104935]: cluster 2023-07-20T15:07:45.880323+0000 mgr.y (mgr.14142) 301 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 6.3 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:48.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:47 smithi029 bash[108361]: audit 2023-07-20T15:07:47.026534+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025221\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025303\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:07:44.340778\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025338\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025369\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025398\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025428\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025458\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025489\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025518\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025547\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_daemon_update\": \"2023-07-20T15:07:47.025631\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:07:48.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:47 smithi029 bash[108361]: audit 2023-07-20T15:07:47.029357+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025221\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025303\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:07:44.340778\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025338\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025369\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025398\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025428\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025458\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025489\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025518\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025547\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_daemon_update\": \"2023-07-20T15:07:47.025631\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:07:48.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:47 smithi029 bash[108361]: audit 2023-07-20T15:07:47.031334+0000 mon.a (mon.0) 807 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:07:48.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:47 smithi029 bash[108361]: audit 2023-07-20T15:07:47.034133+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2023-07-20T15:07:48.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:47 smithi029 bash[108361]: cluster 2023-07-20T15:07:47.037741+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2023-07-20T15:07:48.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:47 smithi029 bash[108361]: cluster 2023-07-20T15:07:47.847042+0000 mon.a (mon.0) 810 : cluster [DBG] Standby manager daemon y started 2023-07-20T15:07:48.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:47 smithi029 bash[104935]: audit 2023-07-20T15:07:47.026534+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025221\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025303\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:07:44.340778\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025338\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025369\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025398\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025428\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025458\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025489\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025518\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025547\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_daemon_update\": \"2023-07-20T15:07:47.025631\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]: dispatch 2023-07-20T15:07:48.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:47 smithi029 bash[104935]: audit 2023-07-20T15:07:47.029357+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025221\", \"created\": \"2023-07-20T15:01:08.385489\", \"started\": \"2023-07-20T15:01:08.420332\"}, \"mgr.x\": {\"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025303\", \"created\": \"2023-07-20T15:01:25.257195\", \"started\": \"2023-07-20T15:07:44.340778\"}, \"osd.4\": {\"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025338\", \"created\": \"2023-07-20T15:02:32.970008\", \"started\": \"2023-07-20T15:02:47.527451\"}, \"osd.5\": {\"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025369\", \"created\": \"2023-07-20T15:02:48.109741\", \"started\": \"2023-07-20T15:03:02.382473\"}, \"osd.6\": {\"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025398\", \"created\": \"2023-07-20T15:03:02.897482\", \"started\": \"2023-07-20T15:03:17.652291\"}, \"osd.7\": {\"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025428\", \"created\": \"2023-07-20T15:03:18.281216\", \"started\": \"2023-07-20T15:03:19.204799\"}, \"prometheus.a\": {\"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025458\", \"created\": \"2023-07-20T15:03:34.602933\", \"started\": \"2023-07-20T15:04:02.261139\"}, \"node-exporter.b\": {\"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025489\", \"created\": \"2023-07-20T15:03:37.229888\", \"started\": \"2023-07-20T15:03:39.375117\"}, \"grafana.a\": {\"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025518\", \"created\": \"2023-07-20T15:03:52.727620\", \"started\": \"2023-07-20T15:03:52.834752\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2023-07-20T15:07:47.025547\", \"created\": \"2023-07-20T15:04:38.791823\", \"started\": \"2023-07-20T15:04:38.827724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893\"}}, \"last_daemon_update\": \"2023-07-20T15:07:47.025631\", \"last_device_update\": \"2023-07-20T15:03:22.112801\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.178\"]}, \"last_host_check\": \"2023-07-20T15:00:49.770688\"}"}]': finished 2023-07-20T15:07:48.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:47 smithi029 bash[104935]: audit 2023-07-20T15:07:47.031334+0000 mon.a (mon.0) 807 : audit [DBG] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:07:48.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:47 smithi029 bash[104935]: audit 2023-07-20T15:07:47.034133+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2023-07-20T15:07:48.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:47 smithi029 bash[104935]: cluster 2023-07-20T15:07:47.037741+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2023-07-20T15:07:48.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:47 smithi029 bash[104935]: cluster 2023-07-20T15:07:47.847042+0000 mon.a (mon.0) 810 : cluster [DBG] Standby manager daemon y started 2023-07-20T15:07:48.362 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:48 smithi178 bash[119506]: debug 2023-07-20T15:07:48.213+0000 7f8a91672680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T15:07:48.362 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:48 smithi178 bash[119506]: debug 2023-07-20T15:07:48.313+0000 7f8a91672680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T15:07:49.190 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:49 smithi178 bash[119506]: debug 2023-07-20T15:07:49.057+0000 7f8a91672680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-20T15:07:49.190 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:48 smithi178 bash[104918]: cephadm 2023-07-20T15:07:47.031141+0000 mgr.y (mgr.14142) 302 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec with id 247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f 2023-07-20T15:07:49.190 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:48 smithi178 bash[104918]: cephadm 2023-07-20T15:07:47.032009+0000 mgr.y (mgr.14142) 303 : cephadm [INF] Upgrade: Checking mgr daemons... 2023-07-20T15:07:49.191 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:48 smithi178 bash[104918]: cephadm 2023-07-20T15:07:47.032205+0000 mgr.y (mgr.14142) 304 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2023-07-20T15:07:49.191 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:48 smithi178 bash[104918]: cephadm 2023-07-20T15:07:47.033786+0000 mgr.y (mgr.14142) 305 : cephadm [INF] Upgrade: there are 1 other already-upgraded standby mgrs, failing over 2023-07-20T15:07:49.191 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:48 smithi178 bash[104918]: audit 2023-07-20T15:07:47.103825+0000 mgr.y (mgr.14142) 306 : audit [DBG] from='client.24709 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:49.191 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:48 smithi178 bash[104918]: audit 2023-07-20T15:07:47.389461+0000 mgr.y (mgr.14142) 307 : audit [DBG] from='client.14811 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:49.191 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:48 smithi178 bash[104918]: audit 2023-07-20T15:07:47.665759+0000 mgr.y (mgr.14142) 308 : audit [DBG] from='client.24721 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:49.191 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:48 smithi178 bash[104918]: audit 2023-07-20T15:07:47.979674+0000 mon.c (mon.1) 38 : audit [DBG] from='client.? 172.21.15.29:0/2789944779' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:07:49.191 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:48 smithi178 bash[104918]: audit 2023-07-20T15:07:48.033989+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2023-07-20T15:07:49.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:48 smithi178 bash[104918]: cluster 2023-07-20T15:07:48.034066+0000 mon.a (mon.0) 812 : cluster [DBG] mgrmap e15: x(active, starting, since 0.999548s), standbys: y 2023-07-20T15:07:49.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[108361]: cephadm 2023-07-20T15:07:47.031141+0000 mgr.y (mgr.14142) 302 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec with id 247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f 2023-07-20T15:07:49.201 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[108361]: cephadm 2023-07-20T15:07:47.032009+0000 mgr.y (mgr.14142) 303 : cephadm [INF] Upgrade: Checking mgr daemons... 2023-07-20T15:07:49.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[108361]: cephadm 2023-07-20T15:07:47.032205+0000 mgr.y (mgr.14142) 304 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2023-07-20T15:07:49.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[108361]: cephadm 2023-07-20T15:07:47.033786+0000 mgr.y (mgr.14142) 305 : cephadm [INF] Upgrade: there are 1 other already-upgraded standby mgrs, failing over 2023-07-20T15:07:49.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[108361]: audit 2023-07-20T15:07:47.103825+0000 mgr.y (mgr.14142) 306 : audit [DBG] from='client.24709 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:49.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[108361]: audit 2023-07-20T15:07:47.389461+0000 mgr.y (mgr.14142) 307 : audit [DBG] from='client.14811 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:49.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[108361]: audit 2023-07-20T15:07:47.665759+0000 mgr.y (mgr.14142) 308 : audit [DBG] from='client.24721 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:49.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[108361]: audit 2023-07-20T15:07:47.979674+0000 mon.c (mon.1) 38 : audit [DBG] from='client.? 172.21.15.29:0/2789944779' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:07:49.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[108361]: audit 2023-07-20T15:07:48.033989+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2023-07-20T15:07:49.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[108361]: cluster 2023-07-20T15:07:48.034066+0000 mon.a (mon.0) 812 : cluster [DBG] mgrmap e15: x(active, starting, since 0.999548s), standbys: y 2023-07-20T15:07:49.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[104935]: cephadm 2023-07-20T15:07:47.031141+0000 mgr.y (mgr.14142) 302 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec with id 247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f 2023-07-20T15:07:49.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[104935]: cephadm 2023-07-20T15:07:47.032009+0000 mgr.y (mgr.14142) 303 : cephadm [INF] Upgrade: Checking mgr daemons... 2023-07-20T15:07:49.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[104935]: cephadm 2023-07-20T15:07:47.032205+0000 mgr.y (mgr.14142) 304 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2023-07-20T15:07:49.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[104935]: cephadm 2023-07-20T15:07:47.033786+0000 mgr.y (mgr.14142) 305 : cephadm [INF] Upgrade: there are 1 other already-upgraded standby mgrs, failing over 2023-07-20T15:07:49.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[104935]: audit 2023-07-20T15:07:47.103825+0000 mgr.y (mgr.14142) 306 : audit [DBG] from='client.24709 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:49.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[104935]: audit 2023-07-20T15:07:47.389461+0000 mgr.y (mgr.14142) 307 : audit [DBG] from='client.14811 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:49.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[104935]: audit 2023-07-20T15:07:47.665759+0000 mgr.y (mgr.14142) 308 : audit [DBG] from='client.24721 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:49.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[104935]: audit 2023-07-20T15:07:47.979674+0000 mon.c (mon.1) 38 : audit [DBG] from='client.? 172.21.15.29:0/2789944779' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:07:49.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[104935]: audit 2023-07-20T15:07:48.033989+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14142 172.21.15.29:0/1639841244' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2023-07-20T15:07:49.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:48 smithi029 bash[104935]: cluster 2023-07-20T15:07:48.034066+0000 mon.a (mon.0) 812 : cluster [DBG] mgrmap e15: x(active, starting, since 0.999548s), standbys: y 2023-07-20T15:07:49.461 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:49 smithi178 bash[119506]: debug 2023-07-20T15:07:49.142+0000 7f8a91672680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T15:07:49.462 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:49 smithi178 bash[119506]: debug 2023-07-20T15:07:49.235+0000 7f8a91672680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T15:07:49.733 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:49 smithi178 bash[119506]: debug 2023-07-20T15:07:49.413+0000 7f8a91672680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T15:07:50.002 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:49 smithi178 bash[119506]: debug 2023-07-20T15:07:49.685+0000 7f8a91672680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T15:07:50.002 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:49 smithi178 bash[119506]: debug 2023-07-20T15:07:49.817+0000 7f8a91672680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T15:07:50.266 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:49 smithi178 bash[119506]: debug 2023-07-20T15:07:49.953+0000 7f8a91672680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T15:07:50.266 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:50 smithi178 bash[119506]: debug 2023-07-20T15:07:50.131+0000 7f8a91672680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T15:07:50.671 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:50 smithi178 bash[119506]: debug 2023-07-20T15:07:50.218+0000 7f8a91672680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T15:07:51.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:50 smithi178 bash[104918]: cluster 2023-07-20T15:07:50.233053+0000 mon.a (mon.0) 813 : cluster [INF] Active manager daemon x restarted 2023-07-20T15:07:51.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:50 smithi178 bash[104918]: cluster 2023-07-20T15:07:50.233668+0000 mon.a (mon.0) 814 : cluster [INF] Activating manager daemon x 2023-07-20T15:07:51.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:50 smithi178 bash[104918]: audit 2023-07-20T15:07:50.233885+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2023-07-20T15:07:51.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:50 smithi178 bash[104918]: cluster 2023-07-20T15:07:50.236554+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2023-07-20T15:07:51.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:50 smithi178 bash[104918]: audit 2023-07-20T15:07:50.236752+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:07:51.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:50 smithi178 bash[104918]: audit 2023-07-20T15:07:50.238223+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2023-07-20T15:07:51.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:50 smithi178 bash[104918]: audit 2023-07-20T15:07:50.238507+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:07:51.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:50 smithi029 bash[104935]: cluster 2023-07-20T15:07:50.233053+0000 mon.a (mon.0) 813 : cluster [INF] Active manager daemon x restarted 2023-07-20T15:07:51.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:50 smithi029 bash[104935]: cluster 2023-07-20T15:07:50.233668+0000 mon.a (mon.0) 814 : cluster [INF] Activating manager daemon x 2023-07-20T15:07:51.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:50 smithi029 bash[104935]: audit 2023-07-20T15:07:50.233885+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2023-07-20T15:07:51.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:50 smithi029 bash[104935]: cluster 2023-07-20T15:07:50.236554+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2023-07-20T15:07:51.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:50 smithi029 bash[104935]: audit 2023-07-20T15:07:50.236752+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:07:51.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:50 smithi029 bash[104935]: audit 2023-07-20T15:07:50.238223+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2023-07-20T15:07:51.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:50 smithi029 bash[104935]: audit 2023-07-20T15:07:50.238507+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:07:51.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:50 smithi029 bash[108361]: cluster 2023-07-20T15:07:50.233053+0000 mon.a (mon.0) 813 : cluster [INF] Active manager daemon x restarted 2023-07-20T15:07:51.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:50 smithi029 bash[108361]: cluster 2023-07-20T15:07:50.233668+0000 mon.a (mon.0) 814 : cluster [INF] Activating manager daemon x 2023-07-20T15:07:51.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:50 smithi029 bash[108361]: audit 2023-07-20T15:07:50.233885+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2023-07-20T15:07:51.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:50 smithi029 bash[108361]: cluster 2023-07-20T15:07:50.236554+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2023-07-20T15:07:51.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:50 smithi029 bash[108361]: audit 2023-07-20T15:07:50.236752+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:07:51.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:50 smithi029 bash[108361]: audit 2023-07-20T15:07:50.238223+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2023-07-20T15:07:51.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:50 smithi029 bash[108361]: audit 2023-07-20T15:07:50.238507+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:07:52.171 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:51 smithi178 bash[104918]: cluster 2023-07-20T15:07:50.873348+0000 mon.a (mon.0) 816 : cluster [DBG] mgrmap e16: x(active, starting, since 0.639895s), standbys: y 2023-07-20T15:07:52.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:51 smithi029 bash[104935]: cluster 2023-07-20T15:07:50.873348+0000 mon.a (mon.0) 816 : cluster [DBG] mgrmap e16: x(active, starting, since 0.639895s), standbys: y 2023-07-20T15:07:52.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:51 smithi029 bash[108361]: cluster 2023-07-20T15:07:50.873348+0000 mon.a (mon.0) 816 : cluster [DBG] mgrmap e16: x(active, starting, since 0.639895s), standbys: y 2023-07-20T15:07:53.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:52 smithi178 bash[104918]: cluster 2023-07-20T15:07:51.869975+0000 mon.a (mon.0) 817 : cluster [DBG] Standby manager daemon y restarted 2023-07-20T15:07:53.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:52 smithi178 bash[104918]: cluster 2023-07-20T15:07:51.870203+0000 mon.a (mon.0) 818 : cluster [DBG] Standby manager daemon y started 2023-07-20T15:07:53.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:52 smithi178 bash[104918]: audit 2023-07-20T15:07:51.870616+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.? 172.21.15.29:0/900645052' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:07:53.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:52 smithi178 bash[104918]: audit 2023-07-20T15:07:51.873862+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.? 172.21.15.29:0/900645052' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:07:53.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:52 smithi178 bash[104918]: cluster 2023-07-20T15:07:51.926164+0000 mon.a (mon.0) 819 : cluster [DBG] mgrmap e17: x(active, starting, since 1.69271s), standbys: y 2023-07-20T15:07:53.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:52 smithi178 bash[104918]: audit 2023-07-20T15:07:51.927444+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-20T15:07:53.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:52 smithi178 bash[104918]: audit 2023-07-20T15:07:51.927638+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-20T15:07:53.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:52 smithi029 bash[104935]: cluster 2023-07-20T15:07:51.869975+0000 mon.a (mon.0) 817 : cluster [DBG] Standby manager daemon y restarted 2023-07-20T15:07:53.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:52 smithi029 bash[104935]: cluster 2023-07-20T15:07:51.870203+0000 mon.a (mon.0) 818 : cluster [DBG] Standby manager daemon y started 2023-07-20T15:07:53.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:52 smithi029 bash[104935]: audit 2023-07-20T15:07:51.870616+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.? 172.21.15.29:0/900645052' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:07:53.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:52 smithi029 bash[104935]: audit 2023-07-20T15:07:51.873862+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.? 172.21.15.29:0/900645052' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:07:53.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:52 smithi029 bash[104935]: cluster 2023-07-20T15:07:51.926164+0000 mon.a (mon.0) 819 : cluster [DBG] mgrmap e17: x(active, starting, since 1.69271s), standbys: y 2023-07-20T15:07:53.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:52 smithi029 bash[104935]: audit 2023-07-20T15:07:51.927444+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-20T15:07:53.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:52 smithi029 bash[104935]: audit 2023-07-20T15:07:51.927638+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-20T15:07:53.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:52 smithi029 bash[108361]: cluster 2023-07-20T15:07:51.869975+0000 mon.a (mon.0) 817 : cluster [DBG] Standby manager daemon y restarted 2023-07-20T15:07:53.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:52 smithi029 bash[108361]: cluster 2023-07-20T15:07:51.870203+0000 mon.a (mon.0) 818 : cluster [DBG] Standby manager daemon y started 2023-07-20T15:07:53.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:52 smithi029 bash[108361]: audit 2023-07-20T15:07:51.870616+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.? 172.21.15.29:0/900645052' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:07:53.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:52 smithi029 bash[108361]: audit 2023-07-20T15:07:51.873862+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.? 172.21.15.29:0/900645052' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:07:53.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:52 smithi029 bash[108361]: cluster 2023-07-20T15:07:51.926164+0000 mon.a (mon.0) 819 : cluster [DBG] mgrmap e17: x(active, starting, since 1.69271s), standbys: y 2023-07-20T15:07:53.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:52 smithi029 bash[108361]: audit 2023-07-20T15:07:51.927444+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-20T15:07:53.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:52 smithi029 bash[108361]: audit 2023-07-20T15:07:51.927638+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-20T15:07:57.015 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENOTSUP: Warning: due to ceph-mgr restart, some PG states may not be up to date 2023-07-20T15:07:57.016 INFO:teuthology.orchestra.run.smithi029.stderr:Module 'orchestrator' is not enabled/loaded (required by command 'orch upgrade status'): use `ceph mgr module enable orchestrator` to enable it 2023-07-20T15:07:57.421 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[119506]: debug 2023-07-20T15:07:56.966+0000 7f8a1bf11700 -1 mgr.server reply reply (95) Operation not supported Warning: due to ceph-mgr restart, some PG states may not be up to date 2023-07-20T15:07:57.422 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[119506]: Module 'orchestrator' is not enabled/loaded (required by command 'orch upgrade status'): use `ceph mgr module enable orchestrator` to enable it 2023-07-20T15:07:57.422 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:07:57 smithi178 bash[119506]: Warning: Permanently added '172.21.15.29' (ECDSA) to the list of known hosts. 2023-07-20T15:07:57.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.875565+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-20T15:07:57.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.875806+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-20T15:07:57.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.876002+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-20T15:07:57.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.877413+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:07:57.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.877690+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:07:57.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.877882+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:07:57.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.878104+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:07:57.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.878300+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:07:57.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.878509+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:07:57.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.878725+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:07:57.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.878933+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:07:57.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.880623+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-20T15:07:57.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.880886+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-20T15:07:57.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.881372+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-20T15:07:57.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.882194+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2023-07-20T15:07:57.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.883005+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2023-07-20T15:07:57.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.883360+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2023-07-20T15:07:57.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.883692+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi029"}]: dispatch 2023-07-20T15:07:57.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.884026+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi178"}]: dispatch 2023-07-20T15:07:57.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.884342+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2023-07-20T15:07:57.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.884696+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2023-07-20T15:07:57.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.885019+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2023-07-20T15:07:57.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.885321+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2023-07-20T15:07:57.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.885636+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2023-07-20T15:07:57.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.885932+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2023-07-20T15:07:57.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.886230+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2023-07-20T15:07:57.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.886536+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2023-07-20T15:07:57.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.886830+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2023-07-20T15:07:57.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.887109+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2023-07-20T15:07:57.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.887381+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2023-07-20T15:07:57.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.887681+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:07:57.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.887966+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:07:57.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.888274+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2023-07-20T15:07:57.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.888575+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2023-07-20T15:07:57.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.888876+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2023-07-20T15:07:57.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.889160+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2023-07-20T15:07:57.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: cluster 2023-07-20T15:07:56.904774+0000 mon.a (mon.0) 820 : cluster [INF] Manager daemon x is now available 2023-07-20T15:07:57.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.915830+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"smithi178\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2023-07-20T15:07:57.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.916462+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"smithi178\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2023-07-20T15:07:57.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.919718+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"smithi178\", \"labels\": [], \"status\": \"\"}}"}]': finished 2023-07-20T15:07:57.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.924358+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2023-07-20T15:07:57.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:56 smithi178 bash[104918]: audit 2023-07-20T15:07:56.924878+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2023-07-20T15:07:57.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.875565+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-20T15:07:57.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.875806+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-20T15:07:57.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.876002+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-20T15:07:57.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.877413+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:07:57.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.877690+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:07:57.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.877882+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:07:57.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.878104+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:07:57.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.878300+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:07:57.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.878509+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:07:57.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.878725+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:07:57.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.878933+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:07:57.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.880623+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-20T15:07:57.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.880886+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-20T15:07:57.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.881372+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-20T15:07:57.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.882194+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2023-07-20T15:07:57.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.883005+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2023-07-20T15:07:57.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.883360+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2023-07-20T15:07:57.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.883692+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi029"}]: dispatch 2023-07-20T15:07:57.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.875565+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-20T15:07:57.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.875806+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-20T15:07:57.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.876002+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-20T15:07:57.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.877413+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:07:57.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.877690+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:07:57.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.877882+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:07:57.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.878104+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:07:57.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.878300+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:07:57.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.878509+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:07:57.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.878725+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:07:57.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.878933+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:07:57.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.880623+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-20T15:07:57.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.880886+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-20T15:07:57.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.881372+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-20T15:07:57.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.882194+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2023-07-20T15:07:57.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.883005+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2023-07-20T15:07:57.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.883360+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2023-07-20T15:07:57.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.883692+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi029"}]: dispatch 2023-07-20T15:07:57.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.884026+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi178"}]: dispatch 2023-07-20T15:07:57.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.884342+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2023-07-20T15:07:57.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.884696+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2023-07-20T15:07:57.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.885019+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2023-07-20T15:07:57.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.885321+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2023-07-20T15:07:57.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.885636+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2023-07-20T15:07:57.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.885932+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2023-07-20T15:07:57.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.886230+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2023-07-20T15:07:57.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.886536+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2023-07-20T15:07:57.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.886830+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2023-07-20T15:07:57.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.887109+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2023-07-20T15:07:57.459 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.887381+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2023-07-20T15:07:57.459 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.887681+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:07:57.459 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.887966+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:07:57.459 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.888274+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2023-07-20T15:07:57.459 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.888575+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2023-07-20T15:07:57.459 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.884026+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi178"}]: dispatch 2023-07-20T15:07:57.460 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.884342+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2023-07-20T15:07:57.460 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.884696+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2023-07-20T15:07:57.460 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.885019+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2023-07-20T15:07:57.460 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.885321+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2023-07-20T15:07:57.460 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.885636+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2023-07-20T15:07:57.460 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.885932+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2023-07-20T15:07:57.460 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.886230+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2023-07-20T15:07:57.461 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.886536+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2023-07-20T15:07:57.461 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.886830+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2023-07-20T15:07:57.461 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.887109+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2023-07-20T15:07:57.461 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.887381+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2023-07-20T15:07:57.461 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.887681+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:07:57.461 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.887966+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:07:57.461 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.888274+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2023-07-20T15:07:57.462 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.888575+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2023-07-20T15:07:57.462 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.888876+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2023-07-20T15:07:57.462 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.889160+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2023-07-20T15:07:57.462 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: cluster 2023-07-20T15:07:56.904774+0000 mon.a (mon.0) 820 : cluster [INF] Manager daemon x is now available 2023-07-20T15:07:57.462 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.915830+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"smithi178\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2023-07-20T15:07:57.462 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.916462+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"smithi178\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2023-07-20T15:07:57.463 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.919718+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"smithi178\", \"labels\": [], \"status\": \"\"}}"}]': finished 2023-07-20T15:07:57.463 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.924358+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2023-07-20T15:07:57.463 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[104935]: audit 2023-07-20T15:07:56.924878+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2023-07-20T15:07:57.463 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.888876+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2023-07-20T15:07:57.463 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.889160+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2023-07-20T15:07:57.463 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: cluster 2023-07-20T15:07:56.904774+0000 mon.a (mon.0) 820 : cluster [INF] Manager daemon x is now available 2023-07-20T15:07:57.464 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.915830+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"smithi178\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2023-07-20T15:07:57.464 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.916462+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"smithi178\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2023-07-20T15:07:57.464 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.919718+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"smithi178\", \"labels\": [], \"status\": \"\"}}"}]': finished 2023-07-20T15:07:57.464 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.924358+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2023-07-20T15:07:57.464 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:56 smithi029 bash[108361]: audit 2023-07-20T15:07:56.924878+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2023-07-20T15:07:58.235 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:57 smithi178 bash[104918]: cephadm 2023-07-20T15:07:56.915453+0000 mgr.x (mgr.34649) 1 : cephadm [INF] inventory: adjusted host smithi029 addr 'smithi029' -> '172.21.15.29' 2023-07-20T15:07:58.235 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:57 smithi178 bash[104918]: cephadm 2023-07-20T15:07:56.924090+0000 mgr.x (mgr.34649) 2 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2023-07-20T15:07:58.235 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:57 smithi178 bash[104918]: audit 2023-07-20T15:07:56.928284+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2023-07-20T15:07:58.236 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:57 smithi178 bash[104918]: cluster 2023-07-20T15:07:56.964052+0000 mon.a (mon.0) 825 : cluster [DBG] mgrmap e18: x(active, since 6s), standbys: y 2023-07-20T15:07:58.236 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:57 smithi178 bash[104918]: audit 2023-07-20T15:07:56.967228+0000 mgr.x (mgr.34649) 3 : audit [DBG] from='client.24739 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:58.236 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:57 smithi178 bash[104918]: cluster 2023-07-20T15:07:56.968623+0000 mgr.x (mgr.34649) 4 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:58.236 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:57 smithi178 bash[104918]: audit 2023-07-20T15:07:57.022701+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2023-07-20T15:07:58.236 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:57 smithi178 bash[104918]: audit 2023-07-20T15:07:57.023075+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2023-07-20T15:07:58.236 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:57 smithi178 bash[104918]: audit 2023-07-20T15:07:57.027285+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]': finished 2023-07-20T15:07:58.236 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:57 smithi178 bash[104918]: audit 2023-07-20T15:07:57.028539+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:07:58.237 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:57 smithi178 bash[104918]: audit 2023-07-20T15:07:57.029937+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:07:58.237 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:57 smithi178 bash[104918]: audit 2023-07-20T15:07:57.062225+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:07:58.237 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:57 smithi178 bash[104918]: audit 2023-07-20T15:07:57.062578+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:07:58.237 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:57 smithi178 bash[104918]: audit 2023-07-20T15:07:57.066811+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-20T15:07:58.237 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:57 smithi178 bash[104918]: audit 2023-07-20T15:07:57.067119+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-20T15:07:58.238 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[104935]: cephadm 2023-07-20T15:07:56.915453+0000 mgr.x (mgr.34649) 1 : cephadm [INF] inventory: adjusted host smithi029 addr 'smithi029' -> '172.21.15.29' 2023-07-20T15:07:58.238 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[104935]: cephadm 2023-07-20T15:07:56.924090+0000 mgr.x (mgr.34649) 2 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2023-07-20T15:07:58.238 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[104935]: audit 2023-07-20T15:07:56.928284+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2023-07-20T15:07:58.239 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[104935]: cluster 2023-07-20T15:07:56.964052+0000 mon.a (mon.0) 825 : cluster [DBG] mgrmap e18: x(active, since 6s), standbys: y 2023-07-20T15:07:58.239 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[104935]: audit 2023-07-20T15:07:56.967228+0000 mgr.x (mgr.34649) 3 : audit [DBG] from='client.24739 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:58.239 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[104935]: cluster 2023-07-20T15:07:56.968623+0000 mgr.x (mgr.34649) 4 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:58.239 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[104935]: audit 2023-07-20T15:07:57.022701+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2023-07-20T15:07:58.239 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[104935]: audit 2023-07-20T15:07:57.023075+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2023-07-20T15:07:58.239 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[104935]: audit 2023-07-20T15:07:57.027285+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]': finished 2023-07-20T15:07:58.239 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[104935]: audit 2023-07-20T15:07:57.028539+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:07:58.239 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[104935]: audit 2023-07-20T15:07:57.029937+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:07:58.240 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[104935]: audit 2023-07-20T15:07:57.062225+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:07:58.240 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[104935]: audit 2023-07-20T15:07:57.062578+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:07:58.240 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[104935]: audit 2023-07-20T15:07:57.066811+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-20T15:07:58.240 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[104935]: audit 2023-07-20T15:07:57.067119+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-20T15:07:58.240 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[108361]: cephadm 2023-07-20T15:07:56.915453+0000 mgr.x (mgr.34649) 1 : cephadm [INF] inventory: adjusted host smithi029 addr 'smithi029' -> '172.21.15.29' 2023-07-20T15:07:58.240 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[108361]: cephadm 2023-07-20T15:07:56.924090+0000 mgr.x (mgr.34649) 2 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2023-07-20T15:07:58.241 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[108361]: audit 2023-07-20T15:07:56.928284+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2023-07-20T15:07:58.241 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[108361]: cluster 2023-07-20T15:07:56.964052+0000 mon.a (mon.0) 825 : cluster [DBG] mgrmap e18: x(active, since 6s), standbys: y 2023-07-20T15:07:58.241 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[108361]: audit 2023-07-20T15:07:56.967228+0000 mgr.x (mgr.34649) 3 : audit [DBG] from='client.24739 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:07:58.241 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[108361]: cluster 2023-07-20T15:07:56.968623+0000 mgr.x (mgr.34649) 4 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:07:58.241 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[108361]: audit 2023-07-20T15:07:57.022701+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2023-07-20T15:07:58.242 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[108361]: audit 2023-07-20T15:07:57.023075+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2023-07-20T15:07:58.242 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[108361]: audit 2023-07-20T15:07:57.027285+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]': finished 2023-07-20T15:07:58.242 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[108361]: audit 2023-07-20T15:07:57.028539+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:07:58.242 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[108361]: audit 2023-07-20T15:07:57.029937+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:07:58.242 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[108361]: audit 2023-07-20T15:07:57.062225+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:07:58.243 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[108361]: audit 2023-07-20T15:07:57.062578+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:07:58.243 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[108361]: audit 2023-07-20T15:07:57.066811+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-20T15:07:58.243 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:57 smithi029 bash[108361]: audit 2023-07-20T15:07:57.067119+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-20T15:08:00.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:59 smithi178 bash[104918]: cluster 2023-07-20T15:07:58.880925+0000 mgr.x (mgr.34649) 5 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:00.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:07:59 smithi178 bash[104918]: cluster 2023-07-20T15:07:58.968007+0000 mon.a (mon.0) 830 : cluster [DBG] mgrmap e19: x(active, since 8s), standbys: y 2023-07-20T15:08:00.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:59 smithi029 bash[108361]: cluster 2023-07-20T15:07:58.880925+0000 mgr.x (mgr.34649) 5 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:00.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:07:59 smithi029 bash[108361]: cluster 2023-07-20T15:07:58.968007+0000 mon.a (mon.0) 830 : cluster [DBG] mgrmap e19: x(active, since 8s), standbys: y 2023-07-20T15:08:00.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:59 smithi029 bash[104935]: cluster 2023-07-20T15:07:58.880925+0000 mgr.x (mgr.34649) 5 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:00.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:07:59 smithi029 bash[104935]: cluster 2023-07-20T15:07:58.968007+0000 mon.a (mon.0) 830 : cluster [DBG] mgrmap e19: x(active, since 8s), standbys: y 2023-07-20T15:08:01.921 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:01 smithi178 bash[119506]: Warning: Permanently added 'smithi178,172.21.15.178' (ECDSA) to the list of known hosts. 2023-07-20T15:08:02.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:01 smithi178 bash[104918]: cluster 2023-07-20T15:08:00.881540+0000 mgr.x (mgr.34649) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:02.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:01 smithi178 bash[104918]: audit 2023-07-20T15:08:01.451248+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2023-07-20T15:08:02.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:01 smithi178 bash[104918]: audit 2023-07-20T15:08:01.451826+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2023-07-20T15:08:02.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:01 smithi178 bash[104918]: audit 2023-07-20T15:08:01.455667+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]': finished 2023-07-20T15:08:02.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:01 smithi178 bash[104918]: audit 2023-07-20T15:08:01.457583+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.x"}]: dispatch 2023-07-20T15:08:02.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:01 smithi178 bash[104918]: audit 2023-07-20T15:08:01.457839+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.x"}]: dispatch 2023-07-20T15:08:02.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:01 smithi178 bash[104918]: audit 2023-07-20T15:08:01.461019+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.x"}]': finished 2023-07-20T15:08:02.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:01 smithi178 bash[104918]: audit 2023-07-20T15:08:01.464233+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:02.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:01 smithi178 bash[104918]: audit 2023-07-20T15:08:01.735579+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:02.451 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[108361]: cluster 2023-07-20T15:08:00.881540+0000 mgr.x (mgr.34649) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:02.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[108361]: audit 2023-07-20T15:08:01.451248+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2023-07-20T15:08:02.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[108361]: audit 2023-07-20T15:08:01.451826+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2023-07-20T15:08:02.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[108361]: audit 2023-07-20T15:08:01.455667+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]': finished 2023-07-20T15:08:02.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[108361]: audit 2023-07-20T15:08:01.457583+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.x"}]: dispatch 2023-07-20T15:08:02.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[108361]: audit 2023-07-20T15:08:01.457839+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.x"}]: dispatch 2023-07-20T15:08:02.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[108361]: audit 2023-07-20T15:08:01.461019+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.x"}]': finished 2023-07-20T15:08:02.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[108361]: audit 2023-07-20T15:08:01.464233+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:02.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[108361]: audit 2023-07-20T15:08:01.735579+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:02.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[104935]: cluster 2023-07-20T15:08:00.881540+0000 mgr.x (mgr.34649) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:02.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[104935]: audit 2023-07-20T15:08:01.451248+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2023-07-20T15:08:02.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[104935]: audit 2023-07-20T15:08:01.451826+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2023-07-20T15:08:02.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[104935]: audit 2023-07-20T15:08:01.455667+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]': finished 2023-07-20T15:08:02.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[104935]: audit 2023-07-20T15:08:01.457583+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.x"}]: dispatch 2023-07-20T15:08:02.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[104935]: audit 2023-07-20T15:08:01.457839+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.x"}]: dispatch 2023-07-20T15:08:02.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[104935]: audit 2023-07-20T15:08:01.461019+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.x"}]': finished 2023-07-20T15:08:02.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[104935]: audit 2023-07-20T15:08:01.464233+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:02.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:01 smithi029 bash[104935]: audit 2023-07-20T15:08:01.735579+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:04.327 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:03 smithi029 bash[104935]: cluster 2023-07-20T15:08:02.882353+0000 mgr.x (mgr.34649) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:04.327 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:03 smithi029 bash[108361]: cluster 2023-07-20T15:08:02.882353+0000 mgr.x (mgr.34649) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:04.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:03 smithi178 bash[104918]: cluster 2023-07-20T15:08:02.882353+0000 mgr.x (mgr.34649) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:05.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:04 smithi178 bash[104918]: audit 2023-07-20T15:08:04.069277+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:05.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:04 smithi178 bash[104918]: audit 2023-07-20T15:08:04.070017+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:05.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:04 smithi178 bash[104918]: audit 2023-07-20T15:08:04.072766+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:08:05.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:04 smithi178 bash[104918]: audit 2023-07-20T15:08:04.386047+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:05.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:04 smithi178 bash[104918]: audit 2023-07-20T15:08:04.386401+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:05.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:04 smithi178 bash[104918]: audit 2023-07-20T15:08:04.386703+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:05.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:04 smithi178 bash[104918]: audit 2023-07-20T15:08:04.386986+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:05.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:04 smithi178 bash[104918]: audit 2023-07-20T15:08:04.387281+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:05.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:04 smithi178 bash[104918]: audit 2023-07-20T15:08:04.387569+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:05.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:04 smithi178 bash[104918]: audit 2023-07-20T15:08:04.387838+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:05.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:04 smithi178 bash[104918]: audit 2023-07-20T15:08:04.388104+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:05.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:04 smithi178 bash[104918]: audit 2023-07-20T15:08:04.388433+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:05.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[108361]: audit 2023-07-20T15:08:04.069277+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:05.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[104935]: audit 2023-07-20T15:08:04.069277+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:05.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[108361]: audit 2023-07-20T15:08:04.070017+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:05.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[104935]: audit 2023-07-20T15:08:04.070017+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:05.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[104935]: audit 2023-07-20T15:08:04.072766+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:08:05.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[104935]: audit 2023-07-20T15:08:04.386047+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:05.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[104935]: audit 2023-07-20T15:08:04.386401+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:05.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[104935]: audit 2023-07-20T15:08:04.386703+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:05.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[104935]: audit 2023-07-20T15:08:04.386986+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:05.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[104935]: audit 2023-07-20T15:08:04.387281+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:05.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[104935]: audit 2023-07-20T15:08:04.387569+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:05.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[104935]: audit 2023-07-20T15:08:04.387838+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:05.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[104935]: audit 2023-07-20T15:08:04.388104+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:05.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[104935]: audit 2023-07-20T15:08:04.388433+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:05.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[108361]: audit 2023-07-20T15:08:04.072766+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:08:05.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[108361]: audit 2023-07-20T15:08:04.386047+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:05.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[108361]: audit 2023-07-20T15:08:04.386401+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:05.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[108361]: audit 2023-07-20T15:08:04.386703+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:05.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[108361]: audit 2023-07-20T15:08:04.386986+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:05.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[108361]: audit 2023-07-20T15:08:04.387281+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:05.458 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[108361]: audit 2023-07-20T15:08:04.387569+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:05.458 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[108361]: audit 2023-07-20T15:08:04.387838+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:05.458 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[108361]: audit 2023-07-20T15:08:04.388104+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:05.458 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:04 smithi029 bash[108361]: audit 2023-07-20T15:08:04.388433+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:06.109 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:05 smithi178 bash[104918]: cluster 2023-07-20T15:08:04.882765+0000 mgr.x (mgr.34649) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:06.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:05 smithi029 bash[104935]: cluster 2023-07-20T15:08:04.882765+0000 mgr.x (mgr.34649) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:06.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:05 smithi029 bash[108361]: cluster 2023-07-20T15:08:04.882765+0000 mgr.x (mgr.34649) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:08.169 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: cluster 2023-07-20T15:08:06.883129+0000 mgr.x (mgr.34649) 9 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:08.170 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: cluster 2023-07-20T15:08:06.883129+0000 mgr.x (mgr.34649) 9 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:08.170 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.181418+0000 mon.b (mon.2) 87 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:08.171 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.181418+0000 mon.b (mon.2) 87 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:08.172 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.182153+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:08.173 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.182153+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:08.174 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.185347+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:08:08.174 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.482057+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:08.174 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.482420+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:08.175 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.482723+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:08.175 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.482985+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:08.175 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.483257+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:08.175 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.483513+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:08.175 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.483783+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:08.176 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.484032+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:08.176 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.484298+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:08.176 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.485398+0000 mon.b (mon.2) 97 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:08:08.176 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.485640+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:08:08.176 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.185347+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:08:08.177 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.482057+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:08.177 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.482420+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:08.177 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.482723+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:08.177 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.482985+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:08.177 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.483257+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:08.177 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.483513+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:08.178 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.483783+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:08.178 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.484032+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:08.178 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.484298+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:08.178 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.485398+0000 mon.b (mon.2) 97 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:08:08.178 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.485640+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:08:08.179 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.488484+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2023-07-20T15:08:08.179 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: cephadm 2023-07-20T15:08:07.491321+0000 mgr.x (mgr.34649) 10 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2023-07-20T15:08:08.179 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.491554+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:08:08.179 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.492062+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:08:08.179 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.492529+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:08:08.179 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: cephadm 2023-07-20T15:08:07.492962+0000 mgr.x (mgr.34649) 11 : cephadm [INF] Reconfiguring daemon mon.a on smithi029 2023-07-20T15:08:08.179 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[108361]: audit 2023-07-20T15:08:07.493240+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2023-07-20T15:08:08.180 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.488484+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2023-07-20T15:08:08.180 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: cephadm 2023-07-20T15:08:07.491321+0000 mgr.x (mgr.34649) 10 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2023-07-20T15:08:08.180 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.491554+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:08:08.180 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.492062+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:08:08.180 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.492529+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:08:08.181 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: cephadm 2023-07-20T15:08:07.492962+0000 mgr.x (mgr.34649) 11 : cephadm [INF] Reconfiguring daemon mon.a on smithi029 2023-07-20T15:08:08.181 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:07 smithi029 bash[104935]: audit 2023-07-20T15:08:07.493240+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2023-07-20T15:08:08.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: cluster 2023-07-20T15:08:06.883129+0000 mgr.x (mgr.34649) 9 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:08.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.181418+0000 mon.b (mon.2) 87 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:08.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.182153+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:08.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.185347+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:06.043450Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:08:08.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.482057+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:08.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.482420+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:08.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.482723+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:08.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.482985+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:08.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.483257+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:08.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.483513+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:08.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.483783+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:08.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.484032+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:08.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.484298+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:08:08.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.485398+0000 mon.b (mon.2) 97 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:08:08.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.485640+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:08:08.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.488484+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2023-07-20T15:08:08.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: cephadm 2023-07-20T15:08:07.491321+0000 mgr.x (mgr.34649) 10 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2023-07-20T15:08:08.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.491554+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:08:08.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.492062+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:08:08.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.492529+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:08:08.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: cephadm 2023-07-20T15:08:07.492962+0000 mgr.x (mgr.34649) 11 : cephadm [INF] Reconfiguring daemon mon.a on smithi029 2023-07-20T15:08:08.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:07 smithi178 bash[104918]: audit 2023-07-20T15:08:07.493240+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2023-07-20T15:08:09.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:08 smithi178 bash[104918]: audit 2023-07-20T15:08:08.348527+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:09.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:08 smithi178 bash[104918]: audit 2023-07-20T15:08:08.349312+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:09.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:08 smithi178 bash[104918]: audit 2023-07-20T15:08:08.352406+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:08:09.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:08 smithi178 bash[104918]: cephadm 2023-07-20T15:08:08.354108+0000 mgr.x (mgr.34649) 12 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2023-07-20T15:08:09.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:08 smithi178 bash[104918]: audit 2023-07-20T15:08:08.354418+0000 mon.b (mon.2) 103 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:08:09.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:08 smithi178 bash[104918]: audit 2023-07-20T15:08:08.355150+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:08:09.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:08 smithi178 bash[104918]: audit 2023-07-20T15:08:08.355822+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:08:09.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:08 smithi178 bash[104918]: cephadm 2023-07-20T15:08:08.356415+0000 mgr.x (mgr.34649) 13 : cephadm [INF] Reconfiguring daemon mon.c on smithi029 2023-07-20T15:08:09.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:08 smithi178 bash[104918]: audit 2023-07-20T15:08:08.356901+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2023-07-20T15:08:09.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[104935]: audit 2023-07-20T15:08:08.348527+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:09.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[108361]: audit 2023-07-20T15:08:08.348527+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:09.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[104935]: audit 2023-07-20T15:08:08.349312+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:09.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[104935]: audit 2023-07-20T15:08:08.352406+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:08:09.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[104935]: cephadm 2023-07-20T15:08:08.354108+0000 mgr.x (mgr.34649) 12 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2023-07-20T15:08:09.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[104935]: audit 2023-07-20T15:08:08.354418+0000 mon.b (mon.2) 103 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:08:09.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[104935]: audit 2023-07-20T15:08:08.355150+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:08:09.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[104935]: audit 2023-07-20T15:08:08.355822+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:08:09.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[104935]: cephadm 2023-07-20T15:08:08.356415+0000 mgr.x (mgr.34649) 13 : cephadm [INF] Reconfiguring daemon mon.c on smithi029 2023-07-20T15:08:09.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[104935]: audit 2023-07-20T15:08:08.356901+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2023-07-20T15:08:09.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[108361]: audit 2023-07-20T15:08:08.349312+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:09.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[108361]: audit 2023-07-20T15:08:08.352406+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:00:56.620531Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:08:09.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[108361]: cephadm 2023-07-20T15:08:08.354108+0000 mgr.x (mgr.34649) 12 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2023-07-20T15:08:09.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[108361]: audit 2023-07-20T15:08:08.354418+0000 mon.b (mon.2) 103 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:08:09.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[108361]: audit 2023-07-20T15:08:08.355150+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:08:09.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[108361]: audit 2023-07-20T15:08:08.355822+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:08:09.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[108361]: cephadm 2023-07-20T15:08:08.356415+0000 mgr.x (mgr.34649) 13 : cephadm [INF] Reconfiguring daemon mon.c on smithi029 2023-07-20T15:08:09.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:08 smithi029 bash[108361]: audit 2023-07-20T15:08:08.356901+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2023-07-20T15:08:10.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:09 smithi178 bash[104918]: cluster 2023-07-20T15:08:08.883919+0000 mgr.x (mgr.34649) 14 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:10.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:09 smithi178 bash[104918]: audit 2023-07-20T15:08:09.198197+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:10.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:09 smithi178 bash[104918]: audit 2023-07-20T15:08:09.198891+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:10.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:09 smithi178 bash[104918]: audit 2023-07-20T15:08:09.202063+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:10.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:09 smithi178 bash[104918]: cephadm 2023-07-20T15:08:09.204044+0000 mgr.x (mgr.34649) 15 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2023-07-20T15:08:10.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:09 smithi178 bash[104918]: cephadm 2023-07-20T15:08:09.214839+0000 mgr.x (mgr.34649) 16 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi029 2023-07-20T15:08:10.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:09 smithi029 bash[104935]: cluster 2023-07-20T15:08:08.883919+0000 mgr.x (mgr.34649) 14 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:10.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:09 smithi029 bash[108361]: cluster 2023-07-20T15:08:08.883919+0000 mgr.x (mgr.34649) 14 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:10.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:09 smithi029 bash[104935]: audit 2023-07-20T15:08:09.198197+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:10.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:09 smithi029 bash[108361]: audit 2023-07-20T15:08:09.198197+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:10.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:09 smithi029 bash[108361]: audit 2023-07-20T15:08:09.198891+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:10.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:09 smithi029 bash[104935]: audit 2023-07-20T15:08:09.198891+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:10.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:09 smithi029 bash[104935]: audit 2023-07-20T15:08:09.202063+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:10.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:09 smithi029 bash[104935]: cephadm 2023-07-20T15:08:09.204044+0000 mgr.x (mgr.34649) 15 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2023-07-20T15:08:10.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:09 smithi029 bash[104935]: cephadm 2023-07-20T15:08:09.214839+0000 mgr.x (mgr.34649) 16 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi029 2023-07-20T15:08:10.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:09 smithi029 bash[108361]: audit 2023-07-20T15:08:09.202063+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"655bfe86b45f\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 16651386, \"cpu_percentage\": \"0.15%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067693Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:03:59.995798Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2023-07-20T15:03:57.093106Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:04.067920Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:10.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:09 smithi029 bash[108361]: cephadm 2023-07-20T15:08:09.204044+0000 mgr.x (mgr.34649) 15 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2023-07-20T15:08:10.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:09 smithi029 bash[108361]: cephadm 2023-07-20T15:08:09.214839+0000 mgr.x (mgr.34649) 16 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi029 2023-07-20T15:08:12.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:11 smithi178 bash[104918]: cluster 2023-07-20T15:08:10.884369+0000 mgr.x (mgr.34649) 17 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:12.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:11 smithi029 bash[104935]: cluster 2023-07-20T15:08:10.884369+0000 mgr.x (mgr.34649) 17 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:12.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:11 smithi029 bash[108361]: cluster 2023-07-20T15:08:10.884369+0000 mgr.x (mgr.34649) 17 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:14.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:13 smithi178 bash[104918]: cluster 2023-07-20T15:08:12.885059+0000 mgr.x (mgr.34649) 18 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:14.451 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:13 smithi029 bash[104935]: cluster 2023-07-20T15:08:12.885059+0000 mgr.x (mgr.34649) 18 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:14.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:13 smithi029 bash[108361]: cluster 2023-07-20T15:08:12.885059+0000 mgr.x (mgr.34649) 18 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:16.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:15 smithi029 bash[104935]: cluster 2023-07-20T15:08:14.885576+0000 mgr.x (mgr.34649) 19 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:16.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:15 smithi029 bash[108361]: cluster 2023-07-20T15:08:14.885576+0000 mgr.x (mgr.34649) 19 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:16.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:15 smithi178 bash[104918]: cluster 2023-07-20T15:08:14.885576+0000 mgr.x (mgr.34649) 19 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:18.327 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:17 smithi029 bash[104935]: cluster 2023-07-20T15:08:16.886146+0000 mgr.x (mgr.34649) 20 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:18.327 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:17 smithi029 bash[108361]: cluster 2023-07-20T15:08:16.886146+0000 mgr.x (mgr.34649) 20 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:18.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:17 smithi178 bash[104918]: cluster 2023-07-20T15:08:16.886146+0000 mgr.x (mgr.34649) 20 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:18.888 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:18 smithi029 systemd[1]: Stopping Ceph alertmanager.a for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:08:19.202 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:18 smithi029 bash[121612]: ts=2023-07-20T15:08:18.840Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2023-07-20T15:08:19.202 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:19 smithi029 podman[129335]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-alertmanager.a 2023-07-20T15:08:19.516 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:19 smithi029 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@alertmanager.a.service: Succeeded. 2023-07-20T15:08:19.517 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:19 smithi029 systemd[1]: Stopped Ceph alertmanager.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:08:19.517 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:19 smithi029 systemd[1]: Starting Ceph alertmanager.a for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:08:19.517 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:19 smithi029 podman[129377]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-alertmanager.a" found: no such container 2023-07-20T15:08:19.517 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:19 smithi029 systemd[1]: Started Ceph alertmanager.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:08:19.952 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[129394]: ts=2023-07-20T15:08:19.580Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2023-07-20T15:08:19.952 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[129394]: ts=2023-07-20T15:08:19.580Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2023-07-20T15:08:19.952 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[129394]: ts=2023-07-20T15:08:19.581Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.29 port=9094 2023-07-20T15:08:19.952 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[129394]: ts=2023-07-20T15:08:19.582Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2023-07-20T15:08:19.952 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[129394]: ts=2023-07-20T15:08:19.605Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2023-07-20T15:08:19.952 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[129394]: ts=2023-07-20T15:08:19.605Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2023-07-20T15:08:19.953 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[129394]: ts=2023-07-20T15:08:19.608Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2023-07-20T15:08:19.953 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[129394]: ts=2023-07-20T15:08:19.608Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2023-07-20T15:08:20.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:19 smithi178 bash[104918]: cluster 2023-07-20T15:08:18.887019+0000 mgr.x (mgr.34649) 21 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:20.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:19 smithi178 bash[104918]: audit 2023-07-20T15:08:19.270519+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:20.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:19 smithi178 bash[104918]: audit 2023-07-20T15:08:19.271125+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:20.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:19 smithi178 bash[104918]: audit 2023-07-20T15:08:19.274216+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:20.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:19 smithi178 bash[104918]: cephadm 2023-07-20T15:08:19.275718+0000 mgr.x (mgr.34649) 22 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2023-07-20T15:08:20.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:19 smithi178 bash[104918]: audit 2023-07-20T15:08:19.276001+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:08:20.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:19 smithi178 bash[104918]: audit 2023-07-20T15:08:19.276742+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:08:20.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:19 smithi178 bash[104918]: audit 2023-07-20T15:08:19.277416+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:08:20.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:19 smithi178 bash[104918]: cephadm 2023-07-20T15:08:19.278058+0000 mgr.x (mgr.34649) 23 : cephadm [INF] Reconfiguring daemon mon.b on smithi178 2023-07-20T15:08:20.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:19 smithi178 bash[104918]: audit 2023-07-20T15:08:19.278473+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2023-07-20T15:08:20.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[104935]: cluster 2023-07-20T15:08:18.887019+0000 mgr.x (mgr.34649) 21 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:20.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[108361]: cluster 2023-07-20T15:08:18.887019+0000 mgr.x (mgr.34649) 21 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:20.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[104935]: audit 2023-07-20T15:08:19.270519+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:20.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[108361]: audit 2023-07-20T15:08:19.270519+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:20.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[104935]: audit 2023-07-20T15:08:19.271125+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:20.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[104935]: audit 2023-07-20T15:08:19.274216+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:20.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[104935]: cephadm 2023-07-20T15:08:19.275718+0000 mgr.x (mgr.34649) 22 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2023-07-20T15:08:20.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[104935]: audit 2023-07-20T15:08:19.276001+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:08:20.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[104935]: audit 2023-07-20T15:08:19.276742+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:08:20.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[104935]: audit 2023-07-20T15:08:19.277416+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:08:20.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[104935]: cephadm 2023-07-20T15:08:19.278058+0000 mgr.x (mgr.34649) 23 : cephadm [INF] Reconfiguring daemon mon.b on smithi178 2023-07-20T15:08:20.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[104935]: audit 2023-07-20T15:08:19.278473+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2023-07-20T15:08:20.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[108361]: audit 2023-07-20T15:08:19.271125+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:20.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[108361]: audit 2023-07-20T15:08:19.274216+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"2dd3e7d75335\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 322856550, \"cpu_percentage\": \"4.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067106Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T14:59:45.628840Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:25.972960Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:20.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[108361]: cephadm 2023-07-20T15:08:19.275718+0000 mgr.x (mgr.34649) 22 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2023-07-20T15:08:20.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[108361]: audit 2023-07-20T15:08:19.276001+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:08:20.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[108361]: audit 2023-07-20T15:08:19.276742+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:08:20.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[108361]: audit 2023-07-20T15:08:19.277416+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:08:20.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[108361]: cephadm 2023-07-20T15:08:19.278058+0000 mgr.x (mgr.34649) 23 : cephadm [INF] Reconfiguring daemon mon.b on smithi178 2023-07-20T15:08:20.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:19 smithi029 bash[108361]: audit 2023-07-20T15:08:19.278473+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2023-07-20T15:08:21.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:20 smithi178 bash[104918]: audit 2023-07-20T15:08:20.158942+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:21.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:20 smithi178 bash[104918]: audit 2023-07-20T15:08:20.159482+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:21.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:20 smithi178 bash[104918]: audit 2023-07-20T15:08:20.163488+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:08:21.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:20 smithi178 bash[104918]: cephadm 2023-07-20T15:08:20.164832+0000 mgr.x (mgr.34649) 24 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2023-07-20T15:08:21.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:20 smithi178 bash[104918]: cephadm 2023-07-20T15:08:20.172673+0000 mgr.x (mgr.34649) 25 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi178 2023-07-20T15:08:21.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:20 smithi029 bash[104935]: audit 2023-07-20T15:08:20.158942+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:21.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:20 smithi029 bash[108361]: audit 2023-07-20T15:08:20.158942+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:21.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:20 smithi029 bash[104935]: audit 2023-07-20T15:08:20.159482+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:21.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:20 smithi029 bash[104935]: audit 2023-07-20T15:08:20.163488+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:08:21.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:20 smithi029 bash[104935]: cephadm 2023-07-20T15:08:20.164832+0000 mgr.x (mgr.34649) 24 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2023-07-20T15:08:21.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:20 smithi029 bash[104935]: cephadm 2023-07-20T15:08:20.172673+0000 mgr.x (mgr.34649) 25 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi178 2023-07-20T15:08:21.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:20 smithi029 bash[108361]: audit 2023-07-20T15:08:20.159482+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:08:21.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:20 smithi029 bash[108361]: audit 2023-07-20T15:08:20.163488+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"d646b7313f72\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 29454499, \"cpu_percentage\": \"0.24%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179916Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:04:02.261139Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:03:59.706863Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:07.180203Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:08:21.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:20 smithi029 bash[108361]: cephadm 2023-07-20T15:08:20.164832+0000 mgr.x (mgr.34649) 24 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2023-07-20T15:08:21.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:20 smithi029 bash[108361]: cephadm 2023-07-20T15:08:20.172673+0000 mgr.x (mgr.34649) 25 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi178 2023-07-20T15:08:21.952 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:21 smithi029 bash[129394]: ts=2023-07-20T15:08:21.583Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000807266s 2023-07-20T15:08:22.672 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:22 smithi178 bash[104918]: cluster 2023-07-20T15:08:20.887649+0000 mgr.x (mgr.34649) 26 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:22.702 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:22 smithi029 bash[104935]: cluster 2023-07-20T15:08:20.887649+0000 mgr.x (mgr.34649) 26 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:22.702 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:22 smithi029 bash[108361]: cluster 2023-07-20T15:08:20.887649+0000 mgr.x (mgr.34649) 26 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:24.672 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:24 smithi178 bash[104918]: cluster 2023-07-20T15:08:22.888302+0000 mgr.x (mgr.34649) 27 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:24.701 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:24 smithi029 bash[104935]: cluster 2023-07-20T15:08:22.888302+0000 mgr.x (mgr.34649) 27 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:24.702 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:24 smithi029 bash[108361]: cluster 2023-07-20T15:08:22.888302+0000 mgr.x (mgr.34649) 27 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:26.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:25 smithi029 bash[104935]: cluster 2023-07-20T15:08:24.888714+0000 mgr.x (mgr.34649) 28 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:26.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:25 smithi029 bash[108361]: cluster 2023-07-20T15:08:24.888714+0000 mgr.x (mgr.34649) 28 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:26.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:25 smithi178 bash[104918]: cluster 2023-07-20T15:08:24.888714+0000 mgr.x (mgr.34649) 28 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:27.356 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-07-20T15:08:27.989 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-07-20T15:08:27.989 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.a smithi029 starting - - - - 2023-07-20T15:08:27.990 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.a smithi178 running (4m) 20s ago 4m 31.5M - 6.6.2 87a51ecf0b1c 875ebfddec5b 2023-07-20T15:08:27.990 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.x smithi178 running (43s) 20s ago 7m 421M - 16.2.13-355-ge2018073 247668761b27 420b4f2e7f78 2023-07-20T15:08:27.990 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.y smithi029 running (8m) 23s ago 8m 307M - 15.2.0 204a01f9b0b6 2dd3e7d75335 2023-07-20T15:08:27.990 INFO:teuthology.orchestra.run.smithi029.stdout:mon.a smithi029 running (8m) 23s ago 8m 194M 2048M 15.2.0 204a01f9b0b6 e7fb7c490f35 2023-07-20T15:08:27.991 INFO:teuthology.orchestra.run.smithi029.stdout:mon.b smithi178 running (7m) 20s ago 7m 184M 2048M 15.2.0 204a01f9b0b6 61793afb8d4c 2023-07-20T15:08:27.991 INFO:teuthology.orchestra.run.smithi029.stdout:mon.c smithi029 running (7m) 23s ago 7m 185M 2048M 15.2.0 204a01f9b0b6 b4038fa14c38 2023-07-20T15:08:27.991 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.a smithi029 running (4m) 23s ago 4m 13.4M - 1.6.1 458e026e6aa6 a2b5070c8a7f 2023-07-20T15:08:27.991 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.b smithi178 running (4m) 20s ago 4m 10.7M - 1.6.1 458e026e6aa6 ae43907cd0d8 2023-07-20T15:08:27.992 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (6m) 23s ago 6m 69.0M 4096M 15.2.0 204a01f9b0b6 a30d27a6dc87 2023-07-20T15:08:27.992 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (6m) 23s ago 6m 71.9M 4096M 15.2.0 204a01f9b0b6 81d19bc55e70 2023-07-20T15:08:27.992 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (6m) 23s ago 6m 58.4M 4096M 15.2.0 204a01f9b0b6 d60b18f8f253 2023-07-20T15:08:27.993 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi029 running (6m) 23s ago 6m 71.3M 4096M 15.2.0 204a01f9b0b6 0a92a9e1f2da 2023-07-20T15:08:27.993 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi178 running (5m) 20s ago 5m 74.5M 4096M 15.2.0 204a01f9b0b6 b133c6a0654f 2023-07-20T15:08:27.993 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi178 running (5m) 20s ago 5m 69.9M 4096M 15.2.0 204a01f9b0b6 405b4fc27850 2023-07-20T15:08:27.993 INFO:teuthology.orchestra.run.smithi029.stdout:osd.6 smithi178 running (5m) 20s ago 5m 62.1M 4096M 15.2.0 204a01f9b0b6 4311ccd86c8b 2023-07-20T15:08:27.994 INFO:teuthology.orchestra.run.smithi029.stdout:osd.7 smithi178 running (5m) 20s ago 5m 72.7M 4096M 15.2.0 204a01f9b0b6 b2a3cd19518d 2023-07-20T15:08:27.994 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.a smithi178 running (4m) 20s ago 4m 28.0M - 2.45.0 e1fbd49323c6 d646b7313f72 2023-07-20T15:08:27.994 INFO:teuthology.orchestra.run.smithi029.stdout:rgw.r.z.smithi029.fdztmk smithi029 running (3m) 23s ago 3m 52.6M - 15.2.0 204a01f9b0b6 45851ddbab0f 2023-07-20T15:08:27.994 INFO:teuthology.orchestra.run.smithi029.stdout:rgw.r.z.smithi178.bnfxtc smithi178 running (3m) 20s ago 3m 53.2M - 15.2.0 204a01f9b0b6 653ff44a4683 2023-07-20T15:08:28.083 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:27 smithi178 systemd[1]: Stopping Ceph prometheus.a for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:08:28.084 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:27 smithi178 bash[104918]: cluster 2023-07-20T15:08:26.889279+0000 mgr.x (mgr.34649) 29 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:28.084 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:27 smithi178 bash[104918]: audit 2023-07-20T15:08:27.296228+0000 mgr.x (mgr.34649) 30 : audit [DBG] from='client.24754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:08:28.084 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:27 smithi178 bash[104918]: audit 2023-07-20T15:08:27.619292+0000 mgr.x (mgr.34649) 31 : audit [DBG] from='client.24760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:08:28.084 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:27 smithi178 bash[104918]: audit 2023-07-20T15:08:27.932867+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2023-07-20T15:08:28.084 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:27 smithi178 bash[104918]: audit 2023-07-20T15:08:27.933214+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2023-07-20T15:08:28.084 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:27 smithi178 bash[104918]: audit 2023-07-20T15:08:27.933503+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.085 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:27 smithi178 bash[104918]: audit 2023-07-20T15:08:27.933783+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.085 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:27 smithi178 bash[104918]: audit 2023-07-20T15:08:27.934027+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.085 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:27 smithi178 bash[104918]: audit 2023-07-20T15:08:27.934278+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.085 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:27 smithi178 bash[104918]: audit 2023-07-20T15:08:27.935905+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2023-07-20T15:08:28.085 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:27 smithi178 bash[104918]: audit 2023-07-20T15:08:27.936187+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.085 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:27 smithi178 bash[104918]: audit 2023-07-20T15:08:27.936476+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.085 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:27 smithi178 bash[104918]: audit 2023-07-20T15:08:27.936735+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.085 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:27 smithi178 bash[104918]: audit 2023-07-20T15:08:27.936992+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.344 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[116954]: ts=2023-07-20T15:08:28.035Z caller=main.go:854 level=warn msg="Received SIGTERM, exiting gracefully..." 2023-07-20T15:08:28.344 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[116954]: ts=2023-07-20T15:08:28.036Z caller=main.go:878 level=info msg="Stopping scrape discovery manager..." 2023-07-20T15:08:28.345 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[116954]: ts=2023-07-20T15:08:28.036Z caller=main.go:892 level=info msg="Stopping notify discovery manager..." 2023-07-20T15:08:28.345 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[116954]: ts=2023-07-20T15:08:28.036Z caller=manager.go:1009 level=info component="rule manager" msg="Stopping rule manager..." 2023-07-20T15:08:28.345 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[116954]: ts=2023-07-20T15:08:28.036Z caller=manager.go:1019 level=info component="rule manager" msg="Rule manager stopped" 2023-07-20T15:08:28.345 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[116954]: ts=2023-07-20T15:08:28.036Z caller=main.go:929 level=info msg="Stopping scrape manager..." 2023-07-20T15:08:28.345 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[116954]: ts=2023-07-20T15:08:28.036Z caller=main.go:874 level=info msg="Scrape discovery manager stopped" 2023-07-20T15:08:28.345 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[116954]: ts=2023-07-20T15:08:28.036Z caller=main.go:888 level=info msg="Notify discovery manager stopped" 2023-07-20T15:08:28.345 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[116954]: ts=2023-07-20T15:08:28.036Z caller=main.go:921 level=info msg="Scrape manager stopped" 2023-07-20T15:08:28.346 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[116954]: ts=2023-07-20T15:08:28.037Z caller=notifier.go:603 level=info component=notifier msg="Stopping notification manager..." 2023-07-20T15:08:28.346 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[116954]: ts=2023-07-20T15:08:28.037Z caller=main.go:1150 level=info msg="Notifier manager stopped" 2023-07-20T15:08:28.346 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[116954]: ts=2023-07-20T15:08:28.037Z caller=main.go:1162 level=info msg="See you next time!" 2023-07-20T15:08:28.373 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-07-20T15:08:28.373 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-07-20T15:08:28.373 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2023-07-20T15:08:28.373 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:08:28.373 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-07-20T15:08:28.374 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2023-07-20T15:08:28.374 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)": 1 2023-07-20T15:08:28.374 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:08:28.374 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-07-20T15:08:28.374 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2023-07-20T15:08:28.374 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:08:28.375 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": {}, 2023-07-20T15:08:28.375 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw": { 2023-07-20T15:08:28.375 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2023-07-20T15:08:28.375 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:08:28.375 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-07-20T15:08:28.375 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14, 2023-07-20T15:08:28.375 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)": 1 2023-07-20T15:08:28.376 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-07-20T15:08:28.376 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-07-20T15:08:28.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[108361]: cluster 2023-07-20T15:08:26.889279+0000 mgr.x (mgr.34649) 29 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:28.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[108361]: audit 2023-07-20T15:08:27.296228+0000 mgr.x (mgr.34649) 30 : audit [DBG] from='client.24754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:08:28.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[108361]: audit 2023-07-20T15:08:27.619292+0000 mgr.x (mgr.34649) 31 : audit [DBG] from='client.24760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:08:28.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[108361]: audit 2023-07-20T15:08:27.932867+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2023-07-20T15:08:28.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[108361]: audit 2023-07-20T15:08:27.933214+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2023-07-20T15:08:28.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[108361]: audit 2023-07-20T15:08:27.933503+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[108361]: audit 2023-07-20T15:08:27.933783+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[108361]: audit 2023-07-20T15:08:27.934027+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[108361]: audit 2023-07-20T15:08:27.934278+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[108361]: audit 2023-07-20T15:08:27.935905+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2023-07-20T15:08:28.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[108361]: audit 2023-07-20T15:08:27.936187+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[108361]: audit 2023-07-20T15:08:27.936476+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[108361]: audit 2023-07-20T15:08:27.936735+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[108361]: audit 2023-07-20T15:08:27.936992+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[104935]: cluster 2023-07-20T15:08:26.889279+0000 mgr.x (mgr.34649) 29 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:28.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[104935]: audit 2023-07-20T15:08:27.296228+0000 mgr.x (mgr.34649) 30 : audit [DBG] from='client.24754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:08:28.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[104935]: audit 2023-07-20T15:08:27.619292+0000 mgr.x (mgr.34649) 31 : audit [DBG] from='client.24760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:08:28.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[104935]: audit 2023-07-20T15:08:27.932867+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2023-07-20T15:08:28.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[104935]: audit 2023-07-20T15:08:27.933214+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2023-07-20T15:08:28.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[104935]: audit 2023-07-20T15:08:27.933503+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[104935]: audit 2023-07-20T15:08:27.933783+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[104935]: audit 2023-07-20T15:08:27.934027+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[104935]: audit 2023-07-20T15:08:27.934278+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.459 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[104935]: audit 2023-07-20T15:08:27.935905+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2023-07-20T15:08:28.459 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[104935]: audit 2023-07-20T15:08:27.936187+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.459 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[104935]: audit 2023-07-20T15:08:27.936476+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.459 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[104935]: audit 2023-07-20T15:08:27.936735+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.459 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:27 smithi029 bash[104935]: audit 2023-07-20T15:08:27.936992+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:08:28.672 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 podman[121423]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-prometheus.a 2023-07-20T15:08:28.672 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@prometheus.a.service: Succeeded. 2023-07-20T15:08:28.672 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 systemd[1]: Stopped Ceph prometheus.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:08:28.673 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 systemd[1]: Starting Ceph prometheus.a for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:08:28.673 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 podman[121465]: Error: no container with ID or name "ceph-021c9860-270e-11ee-9b34-001a4aab830c-prometheus.a" found: no such container 2023-07-20T15:08:28.673 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 systemd[1]: Started Ceph prometheus.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:08:28.696 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-07-20T15:08:28.696 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec", 2023-07-20T15:08:28.696 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-07-20T15:08:28.697 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading all daemon types on all hosts", 2023-07-20T15:08:28.697 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [], 2023-07-20T15:08:28.697 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "", 2023-07-20T15:08:28.697 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec image", 2023-07-20T15:08:28.697 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-07-20T15:08:28.697 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-07-20T15:08:29.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:27.931057+0000 mgr.x (mgr.34649) 32 : audit [DBG] from='client.24766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:08:29.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.325734+0000 mon.c (mon.1) 41 : audit [DBG] from='client.? 172.21.15.29:0/1306726944' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:08:29.173 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.900Z caller=main.go:534 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2023-07-20T15:08:29.173 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.900Z caller=main.go:578 level=info msg="Starting Prometheus Server" mode=server version="(version=2.45.0, branch=HEAD, revision=8ef767e396bf8445f009f945b0162fd71827f445)" 2023-07-20T15:08:29.173 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.900Z caller=main.go:583 level=info build_context="(go=go1.20.5, platform=linux/amd64, user=root@920118f645b7, date=20230623-15:09:49, tags=netgo,builtinassets,stringlabels)" 2023-07-20T15:08:29.173 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.900Z caller=main.go:584 level=info host_details="(Linux 4.18.0-500.el8.x86_64 #1 SMP Wed Jun 28 00:07:07 UTC 2023 x86_64 smithi178 (none))" 2023-07-20T15:08:29.174 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.900Z caller=main.go:585 level=info fd_limits="(soft=1048576, hard=1048576)" 2023-07-20T15:08:29.174 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.900Z caller=main.go:586 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2023-07-20T15:08:29.174 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.901Z caller=web.go:562 level=info component=web msg="Start listening for connections" address=:9095 2023-07-20T15:08:29.174 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.902Z caller=main.go:1019 level=info msg="Starting TSDB ..." 2023-07-20T15:08:29.174 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.902Z caller=tls_config.go:274 level=info component=web msg="Listening on" address=[::]:9095 2023-07-20T15:08:29.174 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.902Z caller=tls_config.go:277 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2023-07-20T15:08:29.174 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.905Z caller=head.go:595 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2023-07-20T15:08:29.175 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.905Z caller=head.go:676 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.586µs 2023-07-20T15:08:29.175 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.905Z caller=head.go:684 level=info component=tsdb msg="Replaying WAL, this may take a while" 2023-07-20T15:08:29.175 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.905Z caller=head.go:755 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=2 2023-07-20T15:08:29.175 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.913Z caller=head.go:755 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=2 2023-07-20T15:08:29.175 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.914Z caller=head.go:755 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=2 2023-07-20T15:08:29.175 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.914Z caller=head.go:792 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=45.028µs wal_replay_duration=8.88399ms wbl_replay_duration=142ns total_replay_duration=8.955154ms 2023-07-20T15:08:29.175 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.916Z caller=main.go:1040 level=info fs_type=XFS_SUPER_MAGIC 2023-07-20T15:08:29.175 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.916Z caller=main.go:1043 level=info msg="TSDB started" 2023-07-20T15:08:29.176 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.916Z caller=main.go:1224 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2023-07-20T15:08:29.176 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.926Z caller=main.go:1261 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=10.288496ms db_storage=784ns remote_storage=1.163µs web_handler=656ns query_engine=697ns scrape=372.711µs scrape_sd=24.256µs notify=24.475µs notify_sd=5.907µs rules=9.634618ms tracing=5.679µs 2023-07-20T15:08:29.176 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.927Z caller=main.go:1004 level=info msg="Server is ready to receive web requests." 2023-07-20T15:08:29.176 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[121482]: ts=2023-07-20T15:08:28.927Z caller=manager.go:995 level=info component="rule manager" msg="Starting rule manager..." 2023-07-20T15:08:29.177 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.559099+0000 mon.b (mon.2) 125 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:29.177 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.559702+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:29.178 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.562536+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:29.178 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.565775+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-07-20T15:08:29.178 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.566155+0000 mgr.x (mgr.34649) 33 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-07-20T15:08:29.178 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.566932+0000 mon.b (mon.2) 127 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi029.front.sepia.ceph.com:9093"}]: dispatch 2023-07-20T15:08:29.178 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.567178+0000 mgr.x (mgr.34649) 34 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi029.front.sepia.ceph.com:9093"}]: dispatch 2023-07-20T15:08:29.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.567396+0000 mon.b (mon.2) 128 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi029.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2023-07-20T15:08:29.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.567632+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi029.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2023-07-20T15:08:29.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.570512+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi029.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2023-07-20T15:08:29.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.575244+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-07-20T15:08:29.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.575799+0000 mgr.x (mgr.34649) 35 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-07-20T15:08:29.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.577548+0000 mon.b (mon.2) 130 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi178.front.sepia.ceph.com:9095"}]: dispatch 2023-07-20T15:08:29.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.577949+0000 mgr.x (mgr.34649) 36 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi178.front.sepia.ceph.com:9095"}]: dispatch 2023-07-20T15:08:29.180 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.578679+0000 mon.b (mon.2) 131 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi178.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2023-07-20T15:08:29.180 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.578916+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi178.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2023-07-20T15:08:29.180 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.581892+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi178.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2023-07-20T15:08:29.180 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: cephadm 2023-07-20T15:08:28.584716+0000 mgr.x (mgr.34649) 37 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec 2023-07-20T15:08:29.180 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:28 smithi178 bash[104918]: audit 2023-07-20T15:08:28.648653+0000 mgr.x (mgr.34649) 38 : audit [DBG] from='client.24778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:08:29.353 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:27.931057+0000 mgr.x (mgr.34649) 32 : audit [DBG] from='client.24766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:08:29.354 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.325734+0000 mon.c (mon.1) 41 : audit [DBG] from='client.? 172.21.15.29:0/1306726944' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:08:29.354 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.559099+0000 mon.b (mon.2) 125 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:29.354 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:27.931057+0000 mgr.x (mgr.34649) 32 : audit [DBG] from='client.24766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:08:29.355 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.325734+0000 mon.c (mon.1) 41 : audit [DBG] from='client.? 172.21.15.29:0/1306726944' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:08:29.355 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.559702+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:29.356 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.562536+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:29.356 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.565775+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-07-20T15:08:29.356 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.566155+0000 mgr.x (mgr.34649) 33 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-07-20T15:08:29.356 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.566932+0000 mon.b (mon.2) 127 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi029.front.sepia.ceph.com:9093"}]: dispatch 2023-07-20T15:08:29.357 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.559099+0000 mon.b (mon.2) 125 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:29.357 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.567178+0000 mgr.x (mgr.34649) 34 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi029.front.sepia.ceph.com:9093"}]: dispatch 2023-07-20T15:08:29.357 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.567396+0000 mon.b (mon.2) 128 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi029.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2023-07-20T15:08:29.357 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.567632+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi029.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2023-07-20T15:08:29.358 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.570512+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi029.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2023-07-20T15:08:29.358 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.575244+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-07-20T15:08:29.358 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.575799+0000 mgr.x (mgr.34649) 35 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-07-20T15:08:29.358 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.577548+0000 mon.b (mon.2) 130 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi178.front.sepia.ceph.com:9095"}]: dispatch 2023-07-20T15:08:29.358 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.577949+0000 mgr.x (mgr.34649) 36 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi178.front.sepia.ceph.com:9095"}]: dispatch 2023-07-20T15:08:29.358 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.578679+0000 mon.b (mon.2) 131 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi178.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2023-07-20T15:08:29.358 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.578916+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi178.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2023-07-20T15:08:29.359 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.581892+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi178.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2023-07-20T15:08:29.359 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: cephadm 2023-07-20T15:08:28.584716+0000 mgr.x (mgr.34649) 37 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec 2023-07-20T15:08:29.359 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[104935]: audit 2023-07-20T15:08:28.648653+0000 mgr.x (mgr.34649) 38 : audit [DBG] from='client.24778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:08:29.359 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.559702+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:29.360 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.562536+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 193042841, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179414Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"37.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:08:07.179583Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78181826, \"cpu_percentage\": \"0.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179657Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 73368862, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179737Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 65137541, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179797Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 76283904, \"cpu_percentage\": \"0.67%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179856Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11251220, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.179974Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33030144, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180033Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 55847157, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:07.180091Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:29.360 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.565775+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-07-20T15:08:29.360 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.566155+0000 mgr.x (mgr.34649) 33 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-07-20T15:08:29.360 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.566932+0000 mon.b (mon.2) 127 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi029.front.sepia.ceph.com:9093"}]: dispatch 2023-07-20T15:08:29.360 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.567178+0000 mgr.x (mgr.34649) 34 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi029.front.sepia.ceph.com:9093"}]: dispatch 2023-07-20T15:08:29.361 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.567396+0000 mon.b (mon.2) 128 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi029.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2023-07-20T15:08:29.361 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.567632+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi029.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2023-07-20T15:08:29.361 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.570512+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi029.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2023-07-20T15:08:29.361 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.575244+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-07-20T15:08:29.361 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.575799+0000 mgr.x (mgr.34649) 35 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-07-20T15:08:29.361 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.577548+0000 mon.b (mon.2) 130 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi178.front.sepia.ceph.com:9095"}]: dispatch 2023-07-20T15:08:29.362 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.577949+0000 mgr.x (mgr.34649) 36 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi178.front.sepia.ceph.com:9095"}]: dispatch 2023-07-20T15:08:29.362 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.578679+0000 mon.b (mon.2) 131 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi178.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2023-07-20T15:08:29.362 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.578916+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi178.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2023-07-20T15:08:29.362 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.581892+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi178.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2023-07-20T15:08:29.362 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: cephadm 2023-07-20T15:08:28.584716+0000 mgr.x (mgr.34649) 37 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec 2023-07-20T15:08:29.362 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:28 smithi029 bash[108361]: audit 2023-07-20T15:08:28.648653+0000 mgr.x (mgr.34649) 38 : audit [DBG] from='client.24778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:08:29.944 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:08:29 smithi029 bash[129394]: ts=2023-07-20T15:08:29.584Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002397428s 2023-07-20T15:08:30.922 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:30 smithi178 bash[104918]: cluster 2023-07-20T15:08:28.889882+0000 mgr.x (mgr.34649) 39 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:30.922 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:30 smithi178 bash[104918]: audit 2023-07-20T15:08:29.956520+0000 mon.b (mon.2) 132 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\", \"target_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"target_version\": \"16.2.13-355-ge2018073\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2023-07-20T15:08:30.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:30 smithi178 bash[104918]: audit 2023-07-20T15:08:29.957109+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\", \"target_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"target_version\": \"16.2.13-355-ge2018073\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2023-07-20T15:08:30.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:30 smithi178 bash[104918]: audit 2023-07-20T15:08:29.959656+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\", \"target_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"target_version\": \"16.2.13-355-ge2018073\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2023-07-20T15:08:30.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:30 smithi178 bash[104918]: audit 2023-07-20T15:08:29.961461+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:08:30.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:30 smithi178 bash[104918]: audit 2023-07-20T15:08:29.962477+0000 mon.b (mon.2) 134 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:08:30.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:30 smithi178 bash[104918]: audit 2023-07-20T15:08:29.962732+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:08:30.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:30 smithi178 bash[104918]: audit 2023-07-20T15:08:29.965784+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2023-07-20T15:08:30.952 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:30 smithi029 bash[104935]: cluster 2023-07-20T15:08:28.889882+0000 mgr.x (mgr.34649) 39 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:30.952 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:30 smithi029 bash[104935]: audit 2023-07-20T15:08:29.956520+0000 mon.b (mon.2) 132 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\", \"target_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"target_version\": \"16.2.13-355-ge2018073\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2023-07-20T15:08:30.952 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:30 smithi029 bash[104935]: audit 2023-07-20T15:08:29.957109+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\", \"target_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"target_version\": \"16.2.13-355-ge2018073\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2023-07-20T15:08:30.952 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:30 smithi029 bash[104935]: audit 2023-07-20T15:08:29.959656+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\", \"target_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"target_version\": \"16.2.13-355-ge2018073\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2023-07-20T15:08:30.952 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:30 smithi029 bash[104935]: audit 2023-07-20T15:08:29.961461+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:08:30.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:30 smithi029 bash[104935]: audit 2023-07-20T15:08:29.962477+0000 mon.b (mon.2) 134 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:08:30.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:30 smithi029 bash[104935]: audit 2023-07-20T15:08:29.962732+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:08:30.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:30 smithi029 bash[104935]: audit 2023-07-20T15:08:29.965784+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2023-07-20T15:08:30.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:30 smithi029 bash[108361]: cluster 2023-07-20T15:08:28.889882+0000 mgr.x (mgr.34649) 39 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:30.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:30 smithi029 bash[108361]: audit 2023-07-20T15:08:29.956520+0000 mon.b (mon.2) 132 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\", \"target_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"target_version\": \"16.2.13-355-ge2018073\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2023-07-20T15:08:30.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:30 smithi029 bash[108361]: audit 2023-07-20T15:08:29.957109+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\", \"target_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"target_version\": \"16.2.13-355-ge2018073\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2023-07-20T15:08:30.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:30 smithi029 bash[108361]: audit 2023-07-20T15:08:29.959656+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"progress_id\": \"621e45f4-e4e7-4f7c-af57-67e78706edc6\", \"target_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"target_version\": \"16.2.13-355-ge2018073\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2023-07-20T15:08:30.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:30 smithi029 bash[108361]: audit 2023-07-20T15:08:29.961461+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:08:30.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:30 smithi029 bash[108361]: audit 2023-07-20T15:08:29.962477+0000 mon.b (mon.2) 134 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:08:30.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:30 smithi029 bash[108361]: audit 2023-07-20T15:08:29.962732+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:08:30.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:30 smithi029 bash[108361]: audit 2023-07-20T15:08:29.965784+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2023-07-20T15:08:31.907 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[108361]: cephadm 2023-07-20T15:08:29.960407+0000 mgr.x (mgr.34649) 40 : cephadm [INF] Upgrade: Target is version 16.2.13-355-ge2018073 (pacific) 2023-07-20T15:08:31.907 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[108361]: cephadm 2023-07-20T15:08:29.960506+0000 mgr.x (mgr.34649) 41 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d, digests ['quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d'] 2023-07-20T15:08:31.907 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[108361]: cephadm 2023-07-20T15:08:29.966925+0000 mgr.x (mgr.34649) 42 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2023-07-20T15:08:31.907 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[108361]: cephadm 2023-07-20T15:08:29.967398+0000 mgr.x (mgr.34649) 43 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2023-07-20T15:08:31.907 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[108361]: audit 2023-07-20T15:08:30.915607+0000 mon.b (mon.2) 135 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.y"}]: dispatch 2023-07-20T15:08:31.908 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[108361]: audit 2023-07-20T15:08:30.916119+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.y"}]: dispatch 2023-07-20T15:08:31.908 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[108361]: audit 2023-07-20T15:08:30.919615+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.y"}]': finished 2023-07-20T15:08:31.908 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[108361]: audit 2023-07-20T15:08:30.921153+0000 mon.b (mon.2) 136 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:08:31.908 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[108361]: audit 2023-07-20T15:08:30.921386+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:08:31.908 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[108361]: audit 2023-07-20T15:08:30.922292+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-20T15:08:31.908 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[108361]: audit 2023-07-20T15:08:30.923223+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:08:31.908 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[108361]: audit 2023-07-20T15:08:30.924367+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2023-07-20T15:08:31.909 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[104935]: cephadm 2023-07-20T15:08:29.960407+0000 mgr.x (mgr.34649) 40 : cephadm [INF] Upgrade: Target is version 16.2.13-355-ge2018073 (pacific) 2023-07-20T15:08:31.909 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[104935]: cephadm 2023-07-20T15:08:29.960506+0000 mgr.x (mgr.34649) 41 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d, digests ['quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d'] 2023-07-20T15:08:31.909 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[104935]: cephadm 2023-07-20T15:08:29.966925+0000 mgr.x (mgr.34649) 42 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2023-07-20T15:08:31.909 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[104935]: cephadm 2023-07-20T15:08:29.967398+0000 mgr.x (mgr.34649) 43 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2023-07-20T15:08:31.909 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[104935]: audit 2023-07-20T15:08:30.915607+0000 mon.b (mon.2) 135 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.y"}]: dispatch 2023-07-20T15:08:31.909 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[104935]: audit 2023-07-20T15:08:30.916119+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.y"}]: dispatch 2023-07-20T15:08:31.910 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[104935]: audit 2023-07-20T15:08:30.919615+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.y"}]': finished 2023-07-20T15:08:31.910 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[104935]: audit 2023-07-20T15:08:30.921153+0000 mon.b (mon.2) 136 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:08:31.910 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[104935]: audit 2023-07-20T15:08:30.921386+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:08:31.910 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[104935]: audit 2023-07-20T15:08:30.922292+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-20T15:08:31.910 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[104935]: audit 2023-07-20T15:08:30.923223+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:08:31.910 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:31 smithi029 bash[104935]: audit 2023-07-20T15:08:30.924367+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2023-07-20T15:08:31.922 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:31 smithi178 bash[104918]: cephadm 2023-07-20T15:08:29.960407+0000 mgr.x (mgr.34649) 40 : cephadm [INF] Upgrade: Target is version 16.2.13-355-ge2018073 (pacific) 2023-07-20T15:08:31.922 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:31 smithi178 bash[104918]: cephadm 2023-07-20T15:08:29.960506+0000 mgr.x (mgr.34649) 41 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d, digests ['quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d'] 2023-07-20T15:08:31.922 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:31 smithi178 bash[104918]: cephadm 2023-07-20T15:08:29.966925+0000 mgr.x (mgr.34649) 42 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2023-07-20T15:08:31.922 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:31 smithi178 bash[104918]: cephadm 2023-07-20T15:08:29.967398+0000 mgr.x (mgr.34649) 43 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2023-07-20T15:08:31.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:31 smithi178 bash[104918]: audit 2023-07-20T15:08:30.915607+0000 mon.b (mon.2) 135 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.y"}]: dispatch 2023-07-20T15:08:31.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:31 smithi178 bash[104918]: audit 2023-07-20T15:08:30.916119+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.y"}]: dispatch 2023-07-20T15:08:31.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:31 smithi178 bash[104918]: audit 2023-07-20T15:08:30.919615+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr.y"}]': finished 2023-07-20T15:08:31.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:31 smithi178 bash[104918]: audit 2023-07-20T15:08:30.921153+0000 mon.b (mon.2) 136 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:08:31.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:31 smithi178 bash[104918]: audit 2023-07-20T15:08:30.921386+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:08:31.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:31 smithi178 bash[104918]: audit 2023-07-20T15:08:30.922292+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-20T15:08:31.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:31 smithi178 bash[104918]: audit 2023-07-20T15:08:30.923223+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:08:31.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:31 smithi178 bash[104918]: audit 2023-07-20T15:08:30.924367+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2023-07-20T15:08:32.202 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:31 smithi029 systemd[1]: Stopping Ceph mgr.y for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:08:32.922 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:32 smithi178 bash[104918]: cluster 2023-07-20T15:08:30.890499+0000 mgr.x (mgr.34649) 44 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:32.922 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:32 smithi178 bash[104918]: cephadm 2023-07-20T15:08:30.915225+0000 mgr.x (mgr.34649) 45 : cephadm [INF] Upgrade: Updating mgr.y 2023-07-20T15:08:32.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:32 smithi178 bash[104918]: cephadm 2023-07-20T15:08:30.923949+0000 mgr.x (mgr.34649) 46 : cephadm [INF] Deploying daemon mgr.y on smithi029 2023-07-20T15:08:32.952 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:32 smithi029 bash[108361]: cluster 2023-07-20T15:08:30.890499+0000 mgr.x (mgr.34649) 44 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:32.952 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:32 smithi029 bash[108361]: cephadm 2023-07-20T15:08:30.915225+0000 mgr.x (mgr.34649) 45 : cephadm [INF] Upgrade: Updating mgr.y 2023-07-20T15:08:32.952 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:32 smithi029 bash[108361]: cephadm 2023-07-20T15:08:30.923949+0000 mgr.x (mgr.34649) 46 : cephadm [INF] Deploying daemon mgr.y on smithi029 2023-07-20T15:08:32.952 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:32 smithi029 bash[104935]: cluster 2023-07-20T15:08:30.890499+0000 mgr.x (mgr.34649) 44 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:32.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:32 smithi029 bash[104935]: cephadm 2023-07-20T15:08:30.915225+0000 mgr.x (mgr.34649) 45 : cephadm [INF] Upgrade: Updating mgr.y 2023-07-20T15:08:32.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:32 smithi029 bash[104935]: cephadm 2023-07-20T15:08:30.923949+0000 mgr.x (mgr.34649) 46 : cephadm [INF] Deploying daemon mgr.y on smithi029 2023-07-20T15:08:34.922 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:34 smithi178 bash[104918]: cluster 2023-07-20T15:08:32.891264+0000 mgr.x (mgr.34649) 47 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:34.952 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:34 smithi029 bash[104935]: cluster 2023-07-20T15:08:32.891264+0000 mgr.x (mgr.34649) 47 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:34.952 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:34 smithi029 bash[108361]: cluster 2023-07-20T15:08:32.891264+0000 mgr.x (mgr.34649) 47 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:36.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:35 smithi029 bash[104935]: cluster 2023-07-20T15:08:34.891768+0000 mgr.x (mgr.34649) 48 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:36.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:35 smithi029 bash[108361]: cluster 2023-07-20T15:08:34.891768+0000 mgr.x (mgr.34649) 48 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:36.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:35 smithi178 bash[104918]: cluster 2023-07-20T15:08:34.891768+0000 mgr.x (mgr.34649) 48 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:38.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:37 smithi178 bash[104918]: cluster 2023-07-20T15:08:36.892230+0000 mgr.x (mgr.34649) 49 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:38.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:37 smithi029 bash[104935]: cluster 2023-07-20T15:08:36.892230+0000 mgr.x (mgr.34649) 49 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:38.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:37 smithi029 bash[108361]: cluster 2023-07-20T15:08:36.892230+0000 mgr.x (mgr.34649) 49 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:40.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:39 smithi178 bash[104918]: cluster 2023-07-20T15:08:38.893115+0000 mgr.x (mgr.34649) 50 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:40.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:39 smithi029 bash[104935]: cluster 2023-07-20T15:08:38.893115+0000 mgr.x (mgr.34649) 50 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:40.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:39 smithi029 bash[108361]: cluster 2023-07-20T15:08:38.893115+0000 mgr.x (mgr.34649) 50 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:42.262 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:41 smithi029 bash[104935]: cluster 2023-07-20T15:08:40.893505+0000 mgr.x (mgr.34649) 51 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:42.263 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:41 smithi029 bash[108361]: cluster 2023-07-20T15:08:40.893505+0000 mgr.x (mgr.34649) 51 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:42.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:41 smithi178 bash[104918]: cluster 2023-07-20T15:08:40.893505+0000 mgr.x (mgr.34649) 51 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:42.615 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:42 smithi029 bash[129889]: time="2023-07-20T15:08:42Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr.y in 10 seconds, resorting to SIGKILL" 2023-07-20T15:08:42.615 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:42 smithi029 bash[129889]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr.y 2023-07-20T15:08:42.952 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:42 smithi029 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.y.service: Main process exited, code=exited, status=137/n/a 2023-07-20T15:08:42.952 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:42 smithi029 bash[129947]: Error: no container with name or ID "ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr.y" found: no such container 2023-07-20T15:08:43.384 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:42 smithi029 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.y.service: Failed with result 'exit-code'. 2023-07-20T15:08:43.384 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:42 smithi029 systemd[1]: Stopped Ceph mgr.y for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:08:43.384 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:43 smithi029 systemd[1]: Starting Ceph mgr.y for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:08:43.952 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:43 smithi029 bash[130084]: 891723c152d43b0525290293063abed5a58180c62b166db2920e8e39f64e52b3 2023-07-20T15:08:43.952 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:43 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:43.449+0000 7f3c62765700 1 -- 172.21.15.29:0/33689228 <== mon.1 v2:172.21.15.29:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c0f800c4e0 con 0x55c0f7fe1400 2023-07-20T15:08:43.952 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:43 smithi029 systemd[1]: Started Ceph mgr.y for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:08:43.952 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:43 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:43.585+0000 7f3c72d4b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T15:08:43.953 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:43 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:43.674+0000 7f3c72d4b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T15:08:44.303 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:44.111+0000 7f3c72d4b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T15:08:44.304 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:43 smithi029 bash[108361]: cluster 2023-07-20T15:08:42.894255+0000 mgr.x (mgr.34649) 52 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:44.305 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:43 smithi029 bash[104935]: cluster 2023-07-20T15:08:42.894255+0000 mgr.x (mgr.34649) 52 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:44.305 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:43 smithi029 bash[108361]: audit 2023-07-20T15:08:43.495423+0000 mon.b (mon.2) 140 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:44.306 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:43 smithi029 bash[104935]: audit 2023-07-20T15:08:43.495423+0000 mon.b (mon.2) 140 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:44.307 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:43 smithi029 bash[108361]: audit 2023-07-20T15:08:43.496038+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:44.307 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:43 smithi029 bash[104935]: audit 2023-07-20T15:08:43.496038+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:44.307 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:43 smithi029 bash[108361]: audit 2023-07-20T15:08:43.498910+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:44.308 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:43 smithi029 bash[108361]: audit 2023-07-20T15:08:43.500637+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:08:44.308 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:43 smithi029 bash[108361]: audit 2023-07-20T15:08:43.502418+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:44.308 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:43 smithi029 bash[108361]: audit 2023-07-20T15:08:43.502843+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:44.308 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:43 smithi029 bash[104935]: audit 2023-07-20T15:08:43.498910+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:44.309 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:43 smithi029 bash[104935]: audit 2023-07-20T15:08:43.500637+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:08:44.309 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:43 smithi029 bash[104935]: audit 2023-07-20T15:08:43.502418+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:44.309 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:43 smithi029 bash[104935]: audit 2023-07-20T15:08:43.502843+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:44.327 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:43 smithi178 bash[104918]: cluster 2023-07-20T15:08:42.894255+0000 mgr.x (mgr.34649) 52 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:44.327 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:43 smithi178 bash[104918]: audit 2023-07-20T15:08:43.495423+0000 mon.b (mon.2) 140 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:44.328 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:43 smithi178 bash[104918]: audit 2023-07-20T15:08:43.496038+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:44.328 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:43 smithi178 bash[104918]: audit 2023-07-20T15:08:43.498910+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 204052889, \"cpu_percentage\": \"2.39%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.066856Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 194405990, \"cpu_percentage\": \"0.87%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067198Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 72351744, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067278Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 75413585, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067356Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 61278781, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067458Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74836869, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067542Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 14124318, \"cpu_percentage\": \"0.41%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067618Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55218012, \"cpu_percentage\": \"0.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:04.067767Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:44.328 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:43 smithi178 bash[104918]: audit 2023-07-20T15:08:43.500637+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:08:44.329 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:43 smithi178 bash[104918]: audit 2023-07-20T15:08:43.502418+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:44.329 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:43 smithi178 bash[104918]: audit 2023-07-20T15:08:43.502843+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:45.383 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:45.002+0000 7f3c72d4b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T15:08:45.383 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:45.088+0000 7f3c72d4b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T15:08:45.702 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:45.335+0000 7f3c72d4b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T15:08:46.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:45 smithi029 bash[104935]: cluster 2023-07-20T15:08:44.894593+0000 mgr.x (mgr.34649) 53 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:46.202 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:45 smithi029 bash[108361]: cluster 2023-07-20T15:08:44.894593+0000 mgr.x (mgr.34649) 53 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:46.392 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:45 smithi178 bash[104918]: cluster 2023-07-20T15:08:44.894593+0000 mgr.x (mgr.34649) 53 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:46.858 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:46.472+0000 7f3c72d4b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T15:08:46.858 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:46.632+0000 7f3c72d4b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T15:08:46.858 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:46.715+0000 7f3c72d4b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T15:08:47.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:46 smithi178 bash[104918]: audit 2023-07-20T15:08:46.604097+0000 mon.b (mon.2) 144 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 232049868, \"cpu_percentage\": \"2.31%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602117Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44019220, \"cpu_percentage\": \"110.11%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:46.602267Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 214643507, \"cpu_percentage\": \"0.86%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602342Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74532782, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602407Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77594624, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602482Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 62788730, \"cpu_percentage\": \"0.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602545Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77405880, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602607Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 13967032, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602668Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\", \"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\"], \"memory_usage\": 19251855, \"cpu_percentage\": \"0.44%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602730Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55375298, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602792Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.602905Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:47.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:46 smithi178 bash[104918]: audit 2023-07-20T15:08:46.604683+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 232049868, \"cpu_percentage\": \"2.31%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602117Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44019220, \"cpu_percentage\": \"110.11%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:46.602267Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 214643507, \"cpu_percentage\": \"0.86%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602342Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74532782, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602407Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77594624, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602482Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 62788730, \"cpu_percentage\": \"0.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602545Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77405880, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602607Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 13967032, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602668Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\", \"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\"], \"memory_usage\": 19251855, \"cpu_percentage\": \"0.44%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602730Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55375298, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602792Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.602905Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:47.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:46 smithi178 bash[104918]: audit 2023-07-20T15:08:46.607618+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 232049868, \"cpu_percentage\": \"2.31%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602117Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44019220, \"cpu_percentage\": \"110.11%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:46.602267Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 214643507, \"cpu_percentage\": \"0.86%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602342Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74532782, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602407Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77594624, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602482Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 62788730, \"cpu_percentage\": \"0.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602545Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77405880, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602607Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 13967032, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602668Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\", \"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\"], \"memory_usage\": 19251855, \"cpu_percentage\": \"0.44%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602730Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55375298, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602792Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.602905Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:47.202 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:46.810+0000 7f3c72d4b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T15:08:47.202 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:47 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:47.019+0000 7f3c72d4b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T15:08:47.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:46 smithi029 bash[108361]: audit 2023-07-20T15:08:46.604097+0000 mon.b (mon.2) 144 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 232049868, \"cpu_percentage\": \"2.31%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602117Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44019220, \"cpu_percentage\": \"110.11%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:46.602267Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 214643507, \"cpu_percentage\": \"0.86%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602342Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74532782, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602407Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77594624, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602482Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 62788730, \"cpu_percentage\": \"0.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602545Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77405880, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602607Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 13967032, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602668Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\", \"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\"], \"memory_usage\": 19251855, \"cpu_percentage\": \"0.44%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602730Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55375298, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602792Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.602905Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:47.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:46 smithi029 bash[104935]: audit 2023-07-20T15:08:46.604097+0000 mon.b (mon.2) 144 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 232049868, \"cpu_percentage\": \"2.31%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602117Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44019220, \"cpu_percentage\": \"110.11%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:46.602267Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 214643507, \"cpu_percentage\": \"0.86%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602342Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74532782, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602407Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77594624, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602482Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 62788730, \"cpu_percentage\": \"0.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602545Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77405880, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602607Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 13967032, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602668Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\", \"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\"], \"memory_usage\": 19251855, \"cpu_percentage\": \"0.44%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602730Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55375298, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602792Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.602905Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:47.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:46 smithi029 bash[108361]: audit 2023-07-20T15:08:46.604683+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 232049868, \"cpu_percentage\": \"2.31%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602117Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44019220, \"cpu_percentage\": \"110.11%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:46.602267Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 214643507, \"cpu_percentage\": \"0.86%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602342Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74532782, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602407Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77594624, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602482Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 62788730, \"cpu_percentage\": \"0.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602545Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77405880, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602607Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 13967032, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602668Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\", \"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\"], \"memory_usage\": 19251855, \"cpu_percentage\": \"0.44%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602730Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55375298, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602792Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.602905Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:47.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:46 smithi029 bash[108361]: audit 2023-07-20T15:08:46.607618+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 232049868, \"cpu_percentage\": \"2.31%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602117Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44019220, \"cpu_percentage\": \"110.11%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:46.602267Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 214643507, \"cpu_percentage\": \"0.86%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602342Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74532782, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602407Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77594624, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602482Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 62788730, \"cpu_percentage\": \"0.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602545Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77405880, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602607Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 13967032, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602668Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\", \"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\"], \"memory_usage\": 19251855, \"cpu_percentage\": \"0.44%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602730Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55375298, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602792Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.602905Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:47.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:46 smithi029 bash[104935]: audit 2023-07-20T15:08:46.604683+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 232049868, \"cpu_percentage\": \"2.31%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602117Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44019220, \"cpu_percentage\": \"110.11%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:46.602267Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 214643507, \"cpu_percentage\": \"0.86%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602342Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74532782, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602407Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77594624, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602482Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 62788730, \"cpu_percentage\": \"0.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602545Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77405880, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602607Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 13967032, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602668Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\", \"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\"], \"memory_usage\": 19251855, \"cpu_percentage\": \"0.44%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602730Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55375298, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602792Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.602905Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:47.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:46 smithi029 bash[104935]: audit 2023-07-20T15:08:46.607618+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 232049868, \"cpu_percentage\": \"2.31%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602117Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44019220, \"cpu_percentage\": \"110.11%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:46.602267Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 214643507, \"cpu_percentage\": \"0.86%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602342Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 74532782, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602407Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77594624, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602482Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 62788730, \"cpu_percentage\": \"0.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602545Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 77405880, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602607Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 13967032, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602668Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\", \"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\"], \"memory_usage\": 19251855, \"cpu_percentage\": \"0.44%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602730Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 55375298, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.602792Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.602905Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:47.476 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:47 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:47.323+0000 7f3c72d4b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T15:08:47.934 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:47 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:47.429+0000 7f3c72d4b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T15:08:47.935 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: cluster 2023-07-20T15:08:46.894976+0000 mgr.x (mgr.34649) 54 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:47.935 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: audit 2023-07-20T15:08:47.000511+0000 mon.b (mon.2) 145 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 214748364, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998514Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 451202252, \"cpu_percentage\": \"13.24%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998654Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80824238, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998737Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 75612815, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998799Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 67161292, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998858Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78664171, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998936Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 36951818, \"cpu_percentage\": \"1.23%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998997Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 10978590, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999057Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33040629, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999117Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 56004444, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999204Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.999330Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:47.936 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: audit 2023-07-20T15:08:47.001098+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 214748364, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998514Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 451202252, \"cpu_percentage\": \"13.24%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998654Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80824238, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998737Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 75612815, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998799Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 67161292, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998858Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78664171, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998936Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 36951818, \"cpu_percentage\": \"1.23%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998997Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 10978590, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999057Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33040629, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999117Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 56004444, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999204Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.999330Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:47.936 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: audit 2023-07-20T15:08:47.003896+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 214748364, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998514Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 451202252, \"cpu_percentage\": \"13.24%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998654Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80824238, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998737Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 75612815, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998799Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 67161292, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998858Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78664171, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998936Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 36951818, \"cpu_percentage\": \"1.23%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998997Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 10978590, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999057Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33040629, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999117Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 56004444, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999204Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.999330Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:47.936 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: audit 2023-07-20T15:08:47.005475+0000 mon.b (mon.2) 146 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:08:47.936 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: audit 2023-07-20T15:08:47.005745+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:08:47.936 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: audit 2023-07-20T15:08:47.008061+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2023-07-20T15:08:47.937 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: audit 2023-07-20T15:08:47.013547+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:08:47.937 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: audit 2023-07-20T15:08:47.014366+0000 mon.b (mon.2) 148 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:08:47.937 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: audit 2023-07-20T15:08:47.014613+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:08:47.937 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: cephadm 2023-07-20T15:08:47.015343+0000 mgr.x (mgr.34649) 55 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2023-07-20T15:08:47.937 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: cephadm 2023-07-20T15:08:47.015757+0000 mgr.x (mgr.34649) 56 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2023-07-20T15:08:47.937 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: cephadm 2023-07-20T15:08:47.017477+0000 mgr.x (mgr.34649) 57 : cephadm [INF] Failing over to other MGR 2023-07-20T15:08:47.937 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: audit 2023-07-20T15:08:47.017644+0000 mon.b (mon.2) 149 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2023-07-20T15:08:47.937 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: audit 2023-07-20T15:08:47.017880+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2023-07-20T15:08:47.938 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: cluster 2023-07-20T15:08:47.021605+0000 mon.a (mon.0) 872 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2023-07-20T15:08:47.938 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: audit 2023-07-20T15:08:47.021998+0000 mon.b (mon.2) 150 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-07-20T15:08:47.938 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: audit 2023-07-20T15:08:47.022505+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-07-20T15:08:47.938 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: audit 2023-07-20T15:08:47.023284+0000 mon.b (mon.2) 151 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-07-20T15:08:47.938 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[104935]: audit 2023-07-20T15:08:47.023444+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-07-20T15:08:48.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: cluster 2023-07-20T15:08:46.894976+0000 mgr.x (mgr.34649) 54 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:48.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: audit 2023-07-20T15:08:47.000511+0000 mon.b (mon.2) 145 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 214748364, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998514Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 451202252, \"cpu_percentage\": \"13.24%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998654Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80824238, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998737Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 75612815, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998799Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 67161292, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998858Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78664171, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998936Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 36951818, \"cpu_percentage\": \"1.23%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998997Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 10978590, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999057Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33040629, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999117Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 56004444, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999204Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.999330Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:48.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: audit 2023-07-20T15:08:47.001098+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 214748364, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998514Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 451202252, \"cpu_percentage\": \"13.24%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998654Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80824238, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998737Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 75612815, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998799Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 67161292, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998858Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78664171, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998936Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 36951818, \"cpu_percentage\": \"1.23%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998997Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 10978590, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999057Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33040629, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999117Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 56004444, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999204Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.999330Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:48.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: audit 2023-07-20T15:08:47.003896+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 214748364, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998514Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 451202252, \"cpu_percentage\": \"13.24%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998654Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80824238, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998737Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 75612815, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998799Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 67161292, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998858Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78664171, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998936Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 36951818, \"cpu_percentage\": \"1.23%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998997Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 10978590, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999057Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33040629, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999117Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 56004444, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999204Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.999330Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:48.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: audit 2023-07-20T15:08:47.005475+0000 mon.b (mon.2) 146 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:08:48.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: audit 2023-07-20T15:08:47.005745+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:08:48.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: audit 2023-07-20T15:08:47.008061+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2023-07-20T15:08:48.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: audit 2023-07-20T15:08:47.013547+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:08:48.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: audit 2023-07-20T15:08:47.014366+0000 mon.b (mon.2) 148 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:08:48.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: audit 2023-07-20T15:08:47.014613+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:08:48.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: cephadm 2023-07-20T15:08:47.015343+0000 mgr.x (mgr.34649) 55 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2023-07-20T15:08:48.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: cephadm 2023-07-20T15:08:47.015757+0000 mgr.x (mgr.34649) 56 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2023-07-20T15:08:48.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: cephadm 2023-07-20T15:08:47.017477+0000 mgr.x (mgr.34649) 57 : cephadm [INF] Failing over to other MGR 2023-07-20T15:08:48.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: audit 2023-07-20T15:08:47.017644+0000 mon.b (mon.2) 149 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2023-07-20T15:08:48.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: audit 2023-07-20T15:08:47.017880+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2023-07-20T15:08:48.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: cluster 2023-07-20T15:08:47.021605+0000 mon.a (mon.0) 872 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2023-07-20T15:08:48.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: audit 2023-07-20T15:08:47.021998+0000 mon.b (mon.2) 150 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-07-20T15:08:48.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: audit 2023-07-20T15:08:47.022505+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-07-20T15:08:48.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: audit 2023-07-20T15:08:47.023284+0000 mon.b (mon.2) 151 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-07-20T15:08:48.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:47 smithi029 bash[108361]: audit 2023-07-20T15:08:47.023444+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-07-20T15:08:48.226 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:48 smithi178 bash[119506]: debug 2023-07-20T15:08:48.010+0000 7f8a7e887700 -1 mgr handle_mgr_map I was active but no longer am 2023-07-20T15:08:48.226 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:48 smithi178 bash[119506]: ignoring --setuser ceph since I am not root 2023-07-20T15:08:48.227 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:48 smithi178 bash[119506]: ignoring --setgroup ceph since I am not root 2023-07-20T15:08:48.227 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:48 smithi178 bash[119506]: debug 2023-07-20T15:08:48.054+0000 7fc646d2a700 1 -- 172.21.15.178:0/570221620 <== mon.2 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5617883ec4e0 con 0x5617883c2c00 2023-07-20T15:08:48.228 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: cluster 2023-07-20T15:08:46.894976+0000 mgr.x (mgr.34649) 54 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 6.5 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:48.228 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: audit 2023-07-20T15:08:47.000511+0000 mon.b (mon.2) 145 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 214748364, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998514Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 451202252, \"cpu_percentage\": \"13.24%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998654Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80824238, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998737Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 75612815, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998799Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 67161292, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998858Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78664171, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998936Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 36951818, \"cpu_percentage\": \"1.23%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998997Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 10978590, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999057Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33040629, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999117Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 56004444, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999204Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.999330Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:48.228 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: audit 2023-07-20T15:08:47.001098+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 214748364, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998514Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 451202252, \"cpu_percentage\": \"13.24%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998654Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80824238, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998737Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 75612815, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998799Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 67161292, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998858Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78664171, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998936Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 36951818, \"cpu_percentage\": \"1.23%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998997Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 10978590, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999057Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33040629, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999117Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 56004444, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999204Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.999330Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]: dispatch 2023-07-20T15:08:48.228 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: audit 2023-07-20T15:08:47.003896+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 214748364, \"cpu_percentage\": \"1.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998514Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 451202252, \"cpu_percentage\": \"13.24%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998654Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80824238, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998737Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 75612815, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998799Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 67161292, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998858Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78664171, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998936Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 36951818, \"cpu_percentage\": \"1.23%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.998997Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 10978590, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999057Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33040629, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999117Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 56004444, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:46.999204Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:46.999330Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}}"}]': finished 2023-07-20T15:08:48.229 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: audit 2023-07-20T15:08:47.005475+0000 mon.b (mon.2) 146 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:08:48.229 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: audit 2023-07-20T15:08:47.005745+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:08:48.229 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: audit 2023-07-20T15:08:47.008061+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2023-07-20T15:08:48.229 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: audit 2023-07-20T15:08:47.013547+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:08:48.229 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: audit 2023-07-20T15:08:47.014366+0000 mon.b (mon.2) 148 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:08:48.229 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: audit 2023-07-20T15:08:47.014613+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:08:48.229 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: cephadm 2023-07-20T15:08:47.015343+0000 mgr.x (mgr.34649) 55 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2023-07-20T15:08:48.230 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: cephadm 2023-07-20T15:08:47.015757+0000 mgr.x (mgr.34649) 56 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2023-07-20T15:08:48.230 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: cephadm 2023-07-20T15:08:47.017477+0000 mgr.x (mgr.34649) 57 : cephadm [INF] Failing over to other MGR 2023-07-20T15:08:48.230 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: audit 2023-07-20T15:08:47.017644+0000 mon.b (mon.2) 149 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2023-07-20T15:08:48.230 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: audit 2023-07-20T15:08:47.017880+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2023-07-20T15:08:48.230 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: cluster 2023-07-20T15:08:47.021605+0000 mon.a (mon.0) 872 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2023-07-20T15:08:48.230 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: audit 2023-07-20T15:08:47.021998+0000 mon.b (mon.2) 150 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-07-20T15:08:48.230 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: audit 2023-07-20T15:08:47.022505+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-07-20T15:08:48.231 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: audit 2023-07-20T15:08:47.023284+0000 mon.b (mon.2) 151 : audit [INF] from='mgr.34649 172.21.15.178:0/4259123748' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-07-20T15:08:48.231 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:47 smithi178 bash[104918]: audit 2023-07-20T15:08:47.023444+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-07-20T15:08:48.642 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:48 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:48.218+0000 7f3c72d4b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-20T15:08:48.642 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:48 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:48.306+0000 7f3c72d4b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T15:08:48.642 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:48 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:48.404+0000 7f3c72d4b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T15:08:48.643 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:48 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:48.594+0000 7f3c72d4b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T15:08:48.672 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:48 smithi178 bash[119506]: debug 2023-07-20T15:08:48.177+0000 7fc656ef2680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T15:08:48.672 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:48 smithi178 bash[119506]: debug 2023-07-20T15:08:48.260+0000 7fc656ef2680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T15:08:49.059 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:48 smithi178 bash[119506]: debug 2023-07-20T15:08:48.625+0000 7fc656ef2680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T15:08:49.197 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:48 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:48.865+0000 7f3c72d4b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T15:08:49.197 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:49.005+0000 7f3c72d4b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T15:08:49.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:49 smithi029 bash[104935]: audit 2023-07-20T15:08:48.012202+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2023-07-20T15:08:49.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:49 smithi029 bash[104935]: cluster 2023-07-20T15:08:48.012268+0000 mon.a (mon.0) 876 : cluster [DBG] mgrmap e20: y(active, starting, since 0.993851s) 2023-07-20T15:08:49.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:49 smithi029 bash[104935]: audit 2023-07-20T15:08:48.022252+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-07-20T15:08:49.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:49 smithi029 bash[104935]: cluster 2023-07-20T15:08:48.022298+0000 mon.a (mon.0) 878 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2023-07-20T15:08:49.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:49 smithi029 bash[108361]: audit 2023-07-20T15:08:48.012202+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2023-07-20T15:08:49.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:49 smithi029 bash[108361]: cluster 2023-07-20T15:08:48.012268+0000 mon.a (mon.0) 876 : cluster [DBG] mgrmap e20: y(active, starting, since 0.993851s) 2023-07-20T15:08:49.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:49 smithi029 bash[108361]: audit 2023-07-20T15:08:48.022252+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-07-20T15:08:49.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:49 smithi029 bash[108361]: cluster 2023-07-20T15:08:48.022298+0000 mon.a (mon.0) 878 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2023-07-20T15:08:49.421 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:49 smithi178 bash[104918]: audit 2023-07-20T15:08:48.012202+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2023-07-20T15:08:49.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:49 smithi178 bash[104918]: cluster 2023-07-20T15:08:48.012268+0000 mon.a (mon.0) 876 : cluster [DBG] mgrmap e20: y(active, starting, since 0.993851s) 2023-07-20T15:08:49.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:49 smithi178 bash[104918]: audit 2023-07-20T15:08:48.022252+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34649 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-07-20T15:08:49.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:49 smithi178 bash[104918]: cluster 2023-07-20T15:08:48.022298+0000 mon.a (mon.0) 878 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2023-07-20T15:08:49.422 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:49 smithi178 bash[119506]: debug 2023-07-20T15:08:49.373+0000 7fc656ef2680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T15:08:49.452 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:49.149+0000 7f3c72d4b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T15:08:49.452 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:49.334+0000 7f3c72d4b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T15:08:49.672 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:49 smithi178 bash[119506]: debug 2023-07-20T15:08:49.457+0000 7fc656ef2680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T15:08:49.952 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:08:49.425+0000 7f3c72d4b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T15:08:50.061 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:49 smithi178 bash[119506]: debug 2023-07-20T15:08:49.671+0000 7fc656ef2680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T15:08:50.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:50 smithi178 bash[104918]: cluster 2023-07-20T15:08:49.438757+0000 mon.a (mon.0) 879 : cluster [INF] Active manager daemon y restarted 2023-07-20T15:08:50.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:50 smithi178 bash[104918]: cluster 2023-07-20T15:08:49.439428+0000 mon.a (mon.0) 880 : cluster [INF] Activating manager daemon y 2023-07-20T15:08:50.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:50 smithi178 bash[104918]: audit 2023-07-20T15:08:49.440113+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-20T15:08:50.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:50 smithi178 bash[104918]: cluster 2023-07-20T15:08:49.442491+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2023-07-20T15:08:50.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:50 smithi178 bash[104918]: audit 2023-07-20T15:08:49.443564+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:08:50.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:50 smithi178 bash[104918]: audit 2023-07-20T15:08:49.444797+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-20T15:08:50.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:50 smithi178 bash[104918]: audit 2023-07-20T15:08:49.445103+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:08:50.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:50 smithi029 bash[104935]: cluster 2023-07-20T15:08:49.438757+0000 mon.a (mon.0) 879 : cluster [INF] Active manager daemon y restarted 2023-07-20T15:08:50.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:50 smithi029 bash[104935]: cluster 2023-07-20T15:08:49.439428+0000 mon.a (mon.0) 880 : cluster [INF] Activating manager daemon y 2023-07-20T15:08:50.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:50 smithi029 bash[104935]: audit 2023-07-20T15:08:49.440113+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-20T15:08:50.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:50 smithi029 bash[104935]: cluster 2023-07-20T15:08:49.442491+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2023-07-20T15:08:50.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:50 smithi029 bash[104935]: audit 2023-07-20T15:08:49.443564+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:08:50.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:50 smithi029 bash[104935]: audit 2023-07-20T15:08:49.444797+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-20T15:08:50.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:50 smithi029 bash[104935]: audit 2023-07-20T15:08:49.445103+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:08:50.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:50 smithi029 bash[108361]: cluster 2023-07-20T15:08:49.438757+0000 mon.a (mon.0) 879 : cluster [INF] Active manager daemon y restarted 2023-07-20T15:08:50.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:50 smithi029 bash[108361]: cluster 2023-07-20T15:08:49.439428+0000 mon.a (mon.0) 880 : cluster [INF] Activating manager daemon y 2023-07-20T15:08:50.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:50 smithi029 bash[108361]: audit 2023-07-20T15:08:49.440113+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-20T15:08:50.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:50 smithi029 bash[108361]: cluster 2023-07-20T15:08:49.442491+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2023-07-20T15:08:50.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:50 smithi029 bash[108361]: audit 2023-07-20T15:08:49.443564+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:08:50.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:50 smithi029 bash[108361]: audit 2023-07-20T15:08:49.444797+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-20T15:08:50.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:50 smithi029 bash[108361]: audit 2023-07-20T15:08:49.445103+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:08:50.922 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:50 smithi178 bash[119506]: debug 2023-07-20T15:08:50.614+0000 7fc656ef2680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T15:08:50.922 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:50 smithi178 bash[119506]: debug 2023-07-20T15:08:50.741+0000 7fc656ef2680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T15:08:50.922 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:50 smithi178 bash[119506]: debug 2023-07-20T15:08:50.820+0000 7fc656ef2680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T15:08:51.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:51 smithi178 bash[104918]: cluster 2023-07-20T15:08:50.020455+0000 mon.a (mon.0) 882 : cluster [DBG] mgrmap e21: y(active, starting, since 0.581181s) 2023-07-20T15:08:51.423 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:50 smithi178 bash[119506]: debug 2023-07-20T15:08:50.911+0000 7fc656ef2680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T15:08:51.423 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:51 smithi178 bash[119506]: debug 2023-07-20T15:08:51.107+0000 7fc656ef2680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T15:08:51.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:51 smithi029 bash[104935]: cluster 2023-07-20T15:08:50.020455+0000 mon.a (mon.0) 882 : cluster [DBG] mgrmap e21: y(active, starting, since 0.581181s) 2023-07-20T15:08:51.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:51 smithi029 bash[108361]: cluster 2023-07-20T15:08:50.020455+0000 mon.a (mon.0) 882 : cluster [DBG] mgrmap e21: y(active, starting, since 0.581181s) 2023-07-20T15:08:51.922 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:51 smithi178 bash[119506]: debug 2023-07-20T15:08:51.389+0000 7fc656ef2680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T15:08:51.922 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:51 smithi178 bash[119506]: debug 2023-07-20T15:08:51.491+0000 7fc656ef2680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T15:08:52.618 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:52 smithi178 bash[119506]: debug 2023-07-20T15:08:52.218+0000 7fc656ef2680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-20T15:08:52.619 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:52 smithi178 bash[119506]: debug 2023-07-20T15:08:52.302+0000 7fc656ef2680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T15:08:52.619 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:52 smithi178 bash[119506]: debug 2023-07-20T15:08:52.393+0000 7fc656ef2680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T15:08:52.881 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:52 smithi178 bash[119506]: debug 2023-07-20T15:08:52.571+0000 7fc656ef2680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T15:08:53.147 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:52 smithi178 bash[119506]: debug 2023-07-20T15:08:52.833+0000 7fc656ef2680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T15:08:53.148 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:52 smithi178 bash[119506]: debug 2023-07-20T15:08:52.964+0000 7fc656ef2680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T15:08:53.408 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:53 smithi178 bash[119506]: debug 2023-07-20T15:08:53.099+0000 7fc656ef2680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T15:08:53.408 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:53 smithi178 bash[119506]: debug 2023-07-20T15:08:53.275+0000 7fc656ef2680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T15:08:53.672 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:08:53 smithi178 bash[119506]: debug 2023-07-20T15:08:53.360+0000 7fc656ef2680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T15:08:53.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:53 smithi178 bash[104918]: cluster 2023-07-20T15:08:53.375031+0000 mon.a (mon.0) 883 : cluster [DBG] Standby manager daemon x started 2023-07-20T15:08:53.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:53 smithi178 bash[104918]: audit 2023-07-20T15:08:53.375132+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.? 172.21.15.178:0/2939995039' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2023-07-20T15:08:53.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:53 smithi178 bash[104918]: audit 2023-07-20T15:08:53.375448+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.? 172.21.15.178:0/2939995039' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:08:53.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:53 smithi178 bash[104918]: audit 2023-07-20T15:08:53.376388+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.? 172.21.15.178:0/2939995039' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2023-07-20T15:08:53.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:53 smithi178 bash[104918]: audit 2023-07-20T15:08:53.376655+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.? 172.21.15.178:0/2939995039' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:08:53.952 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:53 smithi029 bash[104935]: cluster 2023-07-20T15:08:53.375031+0000 mon.a (mon.0) 883 : cluster [DBG] Standby manager daemon x started 2023-07-20T15:08:53.952 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:53 smithi029 bash[104935]: audit 2023-07-20T15:08:53.375132+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.? 172.21.15.178:0/2939995039' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2023-07-20T15:08:53.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:53 smithi029 bash[104935]: audit 2023-07-20T15:08:53.375448+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.? 172.21.15.178:0/2939995039' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:08:53.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:53 smithi029 bash[104935]: audit 2023-07-20T15:08:53.376388+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.? 172.21.15.178:0/2939995039' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2023-07-20T15:08:53.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:53 smithi029 bash[104935]: audit 2023-07-20T15:08:53.376655+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.? 172.21.15.178:0/2939995039' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:08:53.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:53 smithi029 bash[108361]: cluster 2023-07-20T15:08:53.375031+0000 mon.a (mon.0) 883 : cluster [DBG] Standby manager daemon x started 2023-07-20T15:08:53.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:53 smithi029 bash[108361]: audit 2023-07-20T15:08:53.375132+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.? 172.21.15.178:0/2939995039' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2023-07-20T15:08:53.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:53 smithi029 bash[108361]: audit 2023-07-20T15:08:53.375448+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.? 172.21.15.178:0/2939995039' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:08:53.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:53 smithi029 bash[108361]: audit 2023-07-20T15:08:53.376388+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.? 172.21.15.178:0/2939995039' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2023-07-20T15:08:53.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:53 smithi029 bash[108361]: audit 2023-07-20T15:08:53.376655+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.? 172.21.15.178:0/2939995039' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:08:54.922 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:54 smithi178 bash[104918]: cluster 2023-07-20T15:08:53.433530+0000 mon.a (mon.0) 884 : cluster [DBG] mgrmap e22: y(active, starting, since 3s), standbys: x 2023-07-20T15:08:54.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:54 smithi178 bash[104918]: audit 2023-07-20T15:08:53.434340+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-20T15:08:54.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:54 smithi178 bash[104918]: audit 2023-07-20T15:08:53.435002+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-20T15:08:54.952 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:54 smithi029 bash[104935]: cluster 2023-07-20T15:08:53.433530+0000 mon.a (mon.0) 884 : cluster [DBG] mgrmap e22: y(active, starting, since 3s), standbys: x 2023-07-20T15:08:54.952 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:54 smithi029 bash[104935]: audit 2023-07-20T15:08:53.434340+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-20T15:08:54.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:54 smithi029 bash[104935]: audit 2023-07-20T15:08:53.435002+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-20T15:08:54.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:54 smithi029 bash[108361]: cluster 2023-07-20T15:08:53.433530+0000 mon.a (mon.0) 884 : cluster [DBG] mgrmap e22: y(active, starting, since 3s), standbys: x 2023-07-20T15:08:54.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:54 smithi029 bash[108361]: audit 2023-07-20T15:08:53.434340+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-20T15:08:54.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:54 smithi029 bash[108361]: audit 2023-07-20T15:08:53.435002+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.? 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-20T15:08:56.378 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.024374+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-20T15:08:56.379 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.024573+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-20T15:08:56.379 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.024843+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-20T15:08:56.379 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.026408+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:08:56.379 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.026824+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:08:56.380 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.027125+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:08:56.380 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.027429+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:08:56.380 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.027722+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:08:56.380 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.028017+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:08:56.381 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.028382+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:08:56.381 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.028730+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:08:56.381 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.029085+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-20T15:08:56.381 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.029332+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-20T15:08:56.381 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.029848+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-20T15:08:56.381 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.030756+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2023-07-20T15:08:56.382 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.031659+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2023-07-20T15:08:56.382 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.032039+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2023-07-20T15:08:56.382 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.032395+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2023-07-20T15:08:56.382 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.032765+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi029"}]: dispatch 2023-07-20T15:08:56.382 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.033156+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi178"}]: dispatch 2023-07-20T15:08:56.382 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.033552+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2023-07-20T15:08:56.382 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.033908+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2023-07-20T15:08:56.383 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.034271+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2023-07-20T15:08:56.383 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.034637+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2023-07-20T15:08:56.383 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.035024+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2023-07-20T15:08:56.383 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.035416+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2023-07-20T15:08:56.383 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.035779+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2023-07-20T15:08:56.383 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.036115+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2023-07-20T15:08:56.384 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.036477+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2023-07-20T15:08:56.384 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.036827+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2023-07-20T15:08:56.384 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.037175+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2023-07-20T15:08:56.384 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.037522+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2023-07-20T15:08:56.384 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.037859+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:08:56.385 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.038213+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:08:56.385 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.038569+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2023-07-20T15:08:56.385 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.038915+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2023-07-20T15:08:56.385 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.039263+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2023-07-20T15:08:56.385 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: audit 2023-07-20T15:08:56.039651+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2023-07-20T15:08:56.385 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:56 smithi178 bash[104918]: cluster 2023-07-20T15:08:56.065864+0000 mon.a (mon.0) 885 : cluster [INF] Manager daemon y is now available 2023-07-20T15:08:56.386 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: [79B blob data] 2023-07-20T15:08:56.386 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:08:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: [80B blob data] 2023-07-20T15:08:56.386 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.024374+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-20T15:08:56.387 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.024573+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-20T15:08:56.387 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.024843+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-20T15:08:56.387 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.026408+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:08:56.387 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.026824+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:08:56.387 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.027125+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:08:56.387 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.027429+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:08:56.388 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.027722+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:08:56.388 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.028017+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:08:56.388 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.028382+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:08:56.388 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.028730+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:08:56.388 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.029085+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-20T15:08:56.389 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.029332+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-20T15:08:56.389 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.029848+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-20T15:08:56.389 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.030756+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2023-07-20T15:08:56.389 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.031659+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2023-07-20T15:08:56.389 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.032039+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2023-07-20T15:08:56.389 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.032395+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2023-07-20T15:08:56.390 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.024374+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-20T15:08:56.390 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.024573+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-20T15:08:56.390 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.024843+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-20T15:08:56.390 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.026408+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:08:56.390 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.026824+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:08:56.391 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.027125+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:08:56.391 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.027429+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:08:56.391 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.027722+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:08:56.391 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.028017+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:08:56.391 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.028382+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:08:56.391 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.028730+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:08:56.392 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.029085+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-20T15:08:56.392 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.029332+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-20T15:08:56.392 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.029848+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-20T15:08:56.392 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.030756+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2023-07-20T15:08:56.392 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.031659+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2023-07-20T15:08:56.392 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.032039+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2023-07-20T15:08:56.392 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.032395+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2023-07-20T15:08:56.393 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.032765+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi029"}]: dispatch 2023-07-20T15:08:56.393 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.033156+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi178"}]: dispatch 2023-07-20T15:08:56.393 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.033552+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2023-07-20T15:08:56.393 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.033908+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2023-07-20T15:08:56.393 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.034271+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2023-07-20T15:08:56.394 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.034637+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2023-07-20T15:08:56.394 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.035024+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2023-07-20T15:08:56.394 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.035416+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2023-07-20T15:08:56.394 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.035779+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2023-07-20T15:08:56.394 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.036115+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2023-07-20T15:08:56.394 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.036477+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2023-07-20T15:08:56.395 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.036827+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2023-07-20T15:08:56.395 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.037175+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2023-07-20T15:08:56.395 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.037522+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2023-07-20T15:08:56.395 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.037859+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:08:56.395 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.038213+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:08:56.396 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.032765+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi029"}]: dispatch 2023-07-20T15:08:56.396 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.033156+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi178"}]: dispatch 2023-07-20T15:08:56.396 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.033552+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2023-07-20T15:08:56.396 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.033908+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2023-07-20T15:08:56.396 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.034271+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2023-07-20T15:08:56.397 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.034637+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2023-07-20T15:08:56.397 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.035024+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2023-07-20T15:08:56.397 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.035416+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2023-07-20T15:08:56.397 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.035779+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2023-07-20T15:08:56.397 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.036115+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2023-07-20T15:08:56.397 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.036477+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2023-07-20T15:08:56.397 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.036827+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2023-07-20T15:08:56.398 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.037175+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2023-07-20T15:08:56.398 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.037522+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2023-07-20T15:08:56.398 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.037859+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:08:56.398 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.038213+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:08:56.398 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.038569+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2023-07-20T15:08:56.398 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.038915+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2023-07-20T15:08:56.399 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.039263+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2023-07-20T15:08:56.399 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: audit 2023-07-20T15:08:56.039651+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2023-07-20T15:08:56.399 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[108361]: cluster 2023-07-20T15:08:56.065864+0000 mon.a (mon.0) 885 : cluster [INF] Manager daemon y is now available 2023-07-20T15:08:56.399 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.038569+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2023-07-20T15:08:56.399 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.038915+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2023-07-20T15:08:56.399 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.039263+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2023-07-20T15:08:56.400 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: audit 2023-07-20T15:08:56.039651+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2023-07-20T15:08:56.400 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:56 smithi029 bash[104935]: cluster 2023-07-20T15:08:56.065864+0000 mon.a (mon.0) 885 : cluster [INF] Manager daemon y is now available 2023-07-20T15:08:57.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:57 smithi178 bash[104918]: cephadm 2023-07-20T15:08:56.079694+0000 mgr.y (mgr.24784) 1 : cephadm [INF] inventory: adjusted host smithi178 addr 'smithi178' -> '172.21.15.178' 2023-07-20T15:08:57.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:57 smithi178 bash[104918]: audit 2023-07-20T15:08:56.083088+0000 mon.c (mon.1) 86 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"172.21.15.178\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2023-07-20T15:08:57.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:57 smithi178 bash[104918]: audit 2023-07-20T15:08:56.084344+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"172.21.15.178\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2023-07-20T15:08:57.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:57 smithi178 bash[104918]: audit 2023-07-20T15:08:56.087354+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"172.21.15.178\", \"labels\": [], \"status\": \"\"}}"}]': finished 2023-07-20T15:08:57.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:57 smithi178 bash[104918]: cluster 2023-07-20T15:08:56.124915+0000 mon.a (mon.0) 888 : cluster [DBG] mgrmap e23: y(active, since 6s), standbys: x 2023-07-20T15:08:57.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:57 smithi178 bash[104918]: cluster 2023-07-20T15:08:56.129965+0000 mgr.y (mgr.24784) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:57.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:57 smithi178 bash[104918]: audit 2023-07-20T15:08:56.193145+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:08:57.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:57 smithi178 bash[104918]: audit 2023-07-20T15:08:56.194747+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:08:57.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:57 smithi178 bash[104918]: audit 2023-07-20T15:08:56.241047+0000 mon.c (mon.1) 89 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:08:57.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:57 smithi178 bash[104918]: audit 2023-07-20T15:08:56.241442+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:08:57.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:57 smithi178 bash[104918]: audit 2023-07-20T15:08:56.245798+0000 mon.c (mon.1) 90 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2023-07-20T15:08:57.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:57 smithi178 bash[104918]: audit 2023-07-20T15:08:56.246098+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2023-07-20T15:08:57.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:57 smithi178 bash[104918]: audit 2023-07-20T15:08:56.422716+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:57.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:57 smithi178 bash[104918]: audit 2023-07-20T15:08:56.430328+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:57.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[108361]: cephadm 2023-07-20T15:08:56.079694+0000 mgr.y (mgr.24784) 1 : cephadm [INF] inventory: adjusted host smithi178 addr 'smithi178' -> '172.21.15.178' 2023-07-20T15:08:57.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[108361]: audit 2023-07-20T15:08:56.083088+0000 mon.c (mon.1) 86 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"172.21.15.178\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2023-07-20T15:08:57.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[108361]: audit 2023-07-20T15:08:56.084344+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"172.21.15.178\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2023-07-20T15:08:57.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[108361]: audit 2023-07-20T15:08:56.087354+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"172.21.15.178\", \"labels\": [], \"status\": \"\"}}"}]': finished 2023-07-20T15:08:57.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[108361]: cluster 2023-07-20T15:08:56.124915+0000 mon.a (mon.0) 888 : cluster [DBG] mgrmap e23: y(active, since 6s), standbys: x 2023-07-20T15:08:57.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[108361]: cluster 2023-07-20T15:08:56.129965+0000 mgr.y (mgr.24784) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:57.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[108361]: audit 2023-07-20T15:08:56.193145+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:08:57.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[108361]: audit 2023-07-20T15:08:56.194747+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:08:57.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[108361]: audit 2023-07-20T15:08:56.241047+0000 mon.c (mon.1) 89 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:08:57.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[108361]: audit 2023-07-20T15:08:56.241442+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:08:57.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[108361]: audit 2023-07-20T15:08:56.245798+0000 mon.c (mon.1) 90 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2023-07-20T15:08:57.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[108361]: audit 2023-07-20T15:08:56.246098+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2023-07-20T15:08:57.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[108361]: audit 2023-07-20T15:08:56.422716+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:57.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[108361]: audit 2023-07-20T15:08:56.430328+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:57.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[104935]: cephadm 2023-07-20T15:08:56.079694+0000 mgr.y (mgr.24784) 1 : cephadm [INF] inventory: adjusted host smithi178 addr 'smithi178' -> '172.21.15.178' 2023-07-20T15:08:57.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[104935]: audit 2023-07-20T15:08:56.083088+0000 mon.c (mon.1) 86 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"172.21.15.178\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2023-07-20T15:08:57.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[104935]: audit 2023-07-20T15:08:56.084344+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"172.21.15.178\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2023-07-20T15:08:57.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[104935]: audit 2023-07-20T15:08:56.087354+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi029\": {\"hostname\": \"smithi029\", \"addr\": \"172.21.15.29\", \"labels\": [], \"status\": \"\"}, \"smithi178\": {\"hostname\": \"smithi178\", \"addr\": \"172.21.15.178\", \"labels\": [], \"status\": \"\"}}"}]': finished 2023-07-20T15:08:57.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[104935]: cluster 2023-07-20T15:08:56.124915+0000 mon.a (mon.0) 888 : cluster [DBG] mgrmap e23: y(active, since 6s), standbys: x 2023-07-20T15:08:57.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[104935]: cluster 2023-07-20T15:08:56.129965+0000 mgr.y (mgr.24784) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:57.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[104935]: audit 2023-07-20T15:08:56.193145+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:08:57.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[104935]: audit 2023-07-20T15:08:56.194747+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:08:57.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[104935]: audit 2023-07-20T15:08:56.241047+0000 mon.c (mon.1) 89 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:08:57.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[104935]: audit 2023-07-20T15:08:56.241442+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:08:57.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[104935]: audit 2023-07-20T15:08:56.245798+0000 mon.c (mon.1) 90 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2023-07-20T15:08:57.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[104935]: audit 2023-07-20T15:08:56.246098+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2023-07-20T15:08:57.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[104935]: audit 2023-07-20T15:08:56.422716+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:57.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:57 smithi029 bash[104935]: audit 2023-07-20T15:08:56.430328+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:08:59.053 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-07-20T15:08:59.236 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:59 smithi178 bash[104918]: cluster 2023-07-20T15:08:58.028516+0000 mgr.y (mgr.24784) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:59.236 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:08:59 smithi178 bash[104918]: cluster 2023-07-20T15:08:58.129817+0000 mon.a (mon.0) 891 : cluster [DBG] mgrmap e24: y(active, since 8s), standbys: x 2023-07-20T15:08:59.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:59 smithi029 bash[104935]: cluster 2023-07-20T15:08:58.028516+0000 mgr.y (mgr.24784) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:59.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:08:59 smithi029 bash[104935]: cluster 2023-07-20T15:08:58.129817+0000 mon.a (mon.0) 891 : cluster [DBG] mgrmap e24: y(active, since 8s), standbys: x 2023-07-20T15:08:59.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:59 smithi029 bash[108361]: cluster 2023-07-20T15:08:58.028516+0000 mgr.y (mgr.24784) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:08:59.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:08:59 smithi029 bash[108361]: cluster 2023-07-20T15:08:58.129817+0000 mon.a (mon.0) 891 : cluster [DBG] mgrmap e24: y(active, since 8s), standbys: x 2023-07-20T15:08:59.746 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-07-20T15:08:59.746 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.a smithi029 running (40s) 0s ago 5m 18.3M - 0.25.0 c8568f914cd2 27a8d3f42bb2 2023-07-20T15:08:59.746 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.a smithi178 running (5m) 12s ago 5m 31.5M - 6.6.2 87a51ecf0b1c 875ebfddec5b 2023-07-20T15:08:59.746 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.x smithi178 running (75s) 12s ago 7m 430M - 16.2.13-355-ge2018073 247668761b27 420b4f2e7f78 2023-07-20T15:08:59.747 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.y smithi029 *:8443 running (16s) 0s ago 9m 421M - 16.2.13-355-ge2018073 247668761b27 891723c152d4 2023-07-20T15:08:59.747 INFO:teuthology.orchestra.run.smithi029.stdout:mon.a smithi029 running (9m) 0s ago 9m 232M 2048M 15.2.0 204a01f9b0b6 e7fb7c490f35 2023-07-20T15:08:59.747 INFO:teuthology.orchestra.run.smithi029.stdout:mon.b smithi178 running (7m) 12s ago 7m 204M 2048M 15.2.0 204a01f9b0b6 61793afb8d4c 2023-07-20T15:08:59.747 INFO:teuthology.orchestra.run.smithi029.stdout:mon.c smithi029 running (8m) 0s ago 8m 207M 2048M 15.2.0 204a01f9b0b6 b4038fa14c38 2023-07-20T15:08:59.747 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.a smithi029 running (5m) 0s ago 5m 13.0M - 1.6.1 458e026e6aa6 a2b5070c8a7f 2023-07-20T15:08:59.747 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.b smithi178 running (5m) 12s ago 5m 10.4M - 1.6.1 458e026e6aa6 ae43907cd0d8 2023-07-20T15:08:59.747 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (7m) 0s ago 7m 73.0M 4096M 15.2.0 204a01f9b0b6 a30d27a6dc87 2023-07-20T15:08:59.748 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (6m) 0s ago 7m 75.9M 4096M 15.2.0 204a01f9b0b6 81d19bc55e70 2023-07-20T15:08:59.748 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (6m) 0s ago 6m 61.3M 4096M 15.2.0 204a01f9b0b6 d60b18f8f253 2023-07-20T15:08:59.748 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi029 running (6m) 0s ago 6m 75.8M 4096M 15.2.0 204a01f9b0b6 0a92a9e1f2da 2023-07-20T15:08:59.748 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi178 running (6m) 12s ago 6m 77.0M 4096M 15.2.0 204a01f9b0b6 b133c6a0654f 2023-07-20T15:08:59.748 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi178 running (5m) 12s ago 6m 72.1M 4096M 15.2.0 204a01f9b0b6 405b4fc27850 2023-07-20T15:08:59.748 INFO:teuthology.orchestra.run.smithi029.stdout:osd.6 smithi178 running (5m) 12s ago 5m 64.0M 4096M 15.2.0 204a01f9b0b6 4311ccd86c8b 2023-07-20T15:08:59.748 INFO:teuthology.orchestra.run.smithi029.stdout:osd.7 smithi178 running (5m) 12s ago 5m 75.0M 4096M 15.2.0 204a01f9b0b6 b2a3cd19518d 2023-07-20T15:08:59.748 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.a smithi178 running (31s) 12s ago 5m 35.2M - 2.45.0 e1fbd49323c6 71bc04964ce1 2023-07-20T15:08:59.749 INFO:teuthology.orchestra.run.smithi029.stdout:rgw.r.z.smithi029.fdztmk smithi029 running (4m) 0s ago 4m 53.8M - 15.2.0 204a01f9b0b6 45851ddbab0f 2023-07-20T15:08:59.749 INFO:teuthology.orchestra.run.smithi029.stdout:rgw.r.z.smithi178.bnfxtc smithi178 running (4m) 12s ago 4m 53.4M - 15.2.0 204a01f9b0b6 653ff44a4683 2023-07-20T15:09:00.137 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-07-20T15:09:00.137 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-07-20T15:09:00.138 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2023-07-20T15:09:00.138 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:09:00.138 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-07-20T15:09:00.138 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)": 2 2023-07-20T15:09:00.138 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:09:00.138 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-07-20T15:09:00.138 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2023-07-20T15:09:00.139 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:09:00.139 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": {}, 2023-07-20T15:09:00.139 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw": { 2023-07-20T15:09:00.139 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2023-07-20T15:09:00.139 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:09:00.139 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-07-20T15:09:00.139 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 13, 2023-07-20T15:09:00.139 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)": 2 2023-07-20T15:09:00.140 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-07-20T15:09:00.140 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-07-20T15:09:00.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:58.990285+0000 mgr.y (mgr.24784) 4 : audit [DBG] from='client.14901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:00.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.337163+0000 mgr.y (mgr.24784) 5 : audit [DBG] from='client.14907 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:00.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.539050+0000 mon.c (mon.1) 93 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 243898777, \"cpu_percentage\": \"2.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536735Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 442394214, \"cpu_percentage\": \"53.78%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:59.536916Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 217998950, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536995Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 76556533, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537063Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79628861, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537129Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 64298680, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537192Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79524003, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537267Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 13725859, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537333Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 19262341, \"cpu_percentage\": \"0.42%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537395Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 56444846, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537457Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:59.537581Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:00.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.539642+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 243898777, \"cpu_percentage\": \"2.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536735Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 442394214, \"cpu_percentage\": \"53.78%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:59.536916Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 217998950, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536995Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 76556533, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537063Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79628861, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537129Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 64298680, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537192Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79524003, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537267Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 13725859, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537333Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 19262341, \"cpu_percentage\": \"0.42%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537395Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 56444846, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537457Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:59.537581Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:00.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.543683+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 243898777, \"cpu_percentage\": \"2.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536735Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 442394214, \"cpu_percentage\": \"53.78%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:59.536916Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 217998950, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536995Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 76556533, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537063Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79628861, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537129Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 64298680, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537192Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79524003, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537267Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 13725859, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537333Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 19262341, \"cpu_percentage\": \"0.42%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537395Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 56444846, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537457Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:59.537581Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:09:00.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.688687+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:00.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.689097+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:00.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.689432+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.689759+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.690058+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.690380+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.692026+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:00.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.692329+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.692633+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.692925+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.693229+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.852531+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:00.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.852954+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.853309+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:00.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.853620+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.853960+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:00.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.854292+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.854630+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:00.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.854938+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:08:59.855252+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:00.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:09:00.089615+0000 mon.a (mon.0) 894 : audit [DBG] from='client.? 172.21.15.29:0/4096150930' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:09:00.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:09:00.093626+0000 mon.c (mon.1) 114 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 408944640, \"cpu_percentage\": \"19.31%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091707Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:00.092476Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:00.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:09:00.094203+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 408944640, \"cpu_percentage\": \"19.31%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091707Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:00.092476Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:00.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:00 smithi178 bash[104918]: audit 2023-07-20T15:09:00.097355+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 408944640, \"cpu_percentage\": \"19.31%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091707Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:00.092476Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:09:00.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:58.990285+0000 mgr.y (mgr.24784) 4 : audit [DBG] from='client.14901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:00.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.337163+0000 mgr.y (mgr.24784) 5 : audit [DBG] from='client.14907 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:00.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:58.990285+0000 mgr.y (mgr.24784) 4 : audit [DBG] from='client.14901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:00.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.337163+0000 mgr.y (mgr.24784) 5 : audit [DBG] from='client.14907 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:00.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.539050+0000 mon.c (mon.1) 93 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 243898777, \"cpu_percentage\": \"2.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536735Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 442394214, \"cpu_percentage\": \"53.78%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:59.536916Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 217998950, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536995Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 76556533, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537063Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79628861, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537129Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 64298680, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537192Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79524003, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537267Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 13725859, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537333Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 19262341, \"cpu_percentage\": \"0.42%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537395Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 56444846, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537457Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:59.537581Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:00.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.539050+0000 mon.c (mon.1) 93 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 243898777, \"cpu_percentage\": \"2.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536735Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 442394214, \"cpu_percentage\": \"53.78%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:59.536916Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 217998950, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536995Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 76556533, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537063Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79628861, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537129Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 64298680, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537192Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79524003, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537267Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 13725859, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537333Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 19262341, \"cpu_percentage\": \"0.42%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537395Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 56444846, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537457Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:59.537581Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:00.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.539642+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 243898777, \"cpu_percentage\": \"2.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536735Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 442394214, \"cpu_percentage\": \"53.78%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:59.536916Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 217998950, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536995Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 76556533, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537063Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79628861, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537129Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 64298680, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537192Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79524003, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537267Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 13725859, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537333Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 19262341, \"cpu_percentage\": \"0.42%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537395Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 56444846, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537457Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:59.537581Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:00.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.539642+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 243898777, \"cpu_percentage\": \"2.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536735Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 442394214, \"cpu_percentage\": \"53.78%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:59.536916Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 217998950, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536995Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 76556533, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537063Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79628861, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537129Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 64298680, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537192Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79524003, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537267Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 13725859, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537333Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 19262341, \"cpu_percentage\": \"0.42%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537395Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 56444846, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537457Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:59.537581Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:00.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.543683+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 243898777, \"cpu_percentage\": \"2.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536735Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 442394214, \"cpu_percentage\": \"53.78%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:59.536916Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 217998950, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536995Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 76556533, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537063Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79628861, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537129Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 64298680, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537192Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79524003, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537267Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 13725859, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537333Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 19262341, \"cpu_percentage\": \"0.42%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537395Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 56444846, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537457Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:59.537581Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:09:00.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.688687+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:00.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.689097+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:00.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.689432+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.689759+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.690058+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.690380+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.692026+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:00.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.692329+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.692633+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.543683+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"e7fb7c490f35\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 243898777, \"cpu_percentage\": \"2.30%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536735Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T14:59:44.521450Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 442394214, \"cpu_percentage\": \"53.78%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:59.536916Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 217998950, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536995Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 76556533, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537063Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79628861, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537129Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 64298680, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537192Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79524003, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537267Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 13725859, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537333Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 19262341, \"cpu_percentage\": \"0.42%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537395Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 56444846, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537457Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:07.492881Z\"}}, \"last_daemon_update\": \"2023-07-20T15:08:59.537581Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:09:00.458 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.688687+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:00.458 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.689097+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:00.458 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.689432+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.458 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.689759+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.458 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.690058+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.458 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.690380+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.459 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.692026+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:00.459 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.692329+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.459 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.692633+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.459 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.692925+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.459 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.693229+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.460 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.852531+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:00.460 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.852954+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.460 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.853309+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:00.460 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.853620+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.460 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.853960+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:00.460 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.854292+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.460 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.854630+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:00.461 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.854938+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.461 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:08:59.855252+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:00.461 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:09:00.089615+0000 mon.a (mon.0) 894 : audit [DBG] from='client.? 172.21.15.29:0/4096150930' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:09:00.461 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.692925+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.461 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.693229+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.461 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.852531+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:00.462 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.852954+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.462 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.853309+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:00.462 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.853620+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.462 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.853960+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:00.462 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.854292+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.462 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.854630+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:00.462 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.854938+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:00.463 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:08:59.855252+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:00.463 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:09:00.089615+0000 mon.a (mon.0) 894 : audit [DBG] from='client.? 172.21.15.29:0/4096150930' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:09:00.463 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:09:00.093626+0000 mon.c (mon.1) 114 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 408944640, \"cpu_percentage\": \"19.31%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091707Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:00.092476Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:00.464 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:09:00.093626+0000 mon.c (mon.1) 114 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 408944640, \"cpu_percentage\": \"19.31%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091707Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:00.092476Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:00.464 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:09:00.094203+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 408944640, \"cpu_percentage\": \"19.31%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091707Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:00.092476Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:00.464 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[104935]: audit 2023-07-20T15:09:00.097355+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 408944640, \"cpu_percentage\": \"19.31%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091707Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:00.092476Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:09:00.465 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:09:00.094203+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 408944640, \"cpu_percentage\": \"19.31%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091707Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:00.092476Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:00.465 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:00 smithi029 bash[108361]: audit 2023-07-20T15:09:00.097355+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"420b4f2e7f78\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:e20180733e4b085d1abe55675eb8c828b0bfedec\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 408944640, \"cpu_percentage\": \"19.31%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091707Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:07:44.340778Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:07:32.721008Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:00.092476Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:09:00.466 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-07-20T15:09:00.466 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", 2023-07-20T15:09:00.466 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-07-20T15:09:00.466 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading all daemon types on all hosts", 2023-07-20T15:09:00.466 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [ 2023-07-20T15:09:00.466 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr" 2023-07-20T15:09:00.466 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-07-20T15:09:00.467 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "2/20 daemons upgraded", 2023-07-20T15:09:00.467 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "Currently upgrading mgr daemons", 2023-07-20T15:09:00.467 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-07-20T15:09:00.467 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-07-20T15:09:01.402 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: audit 2023-07-20T15:08:59.686673+0000 mgr.y (mgr.24784) 6 : audit [DBG] from='client.14913 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:01.402 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: cluster 2023-07-20T15:09:00.028856+0000 mgr.y (mgr.24784) 7 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:01.402 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: audit 2023-07-20T15:09:00.383409+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:01.403 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: audit 2023-07-20T15:09:00.383828+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:01.403 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: audit 2023-07-20T15:09:00.384176+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:01.403 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: audit 2023-07-20T15:09:00.384485+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:01.403 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: audit 2023-07-20T15:09:00.384800+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:01.403 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: audit 2023-07-20T15:09:00.385097+0000 mon.c (mon.1) 120 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:01.403 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: audit 2023-07-20T15:09:00.385403+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:01.403 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: audit 2023-07-20T15:09:00.385691+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:01.403 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: audit 2023-07-20T15:09:00.385979+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:01.404 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: audit 2023-07-20T15:09:00.387574+0000 mon.c (mon.1) 124 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:01.404 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: audit 2023-07-20T15:09:00.387807+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:01.404 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: audit 2023-07-20T15:09:00.390877+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2023-07-20T15:09:01.404 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: audit 2023-07-20T15:09:00.396277+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:01.404 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: audit 2023-07-20T15:09:00.397193+0000 mon.c (mon.1) 126 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:01.404 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: audit 2023-07-20T15:09:00.397432+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:01.404 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:01 smithi178 bash[104918]: audit 2023-07-20T15:09:00.417784+0000 mgr.y (mgr.24784) 8 : audit [DBG] from='client.24829 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:01.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: audit 2023-07-20T15:08:59.686673+0000 mgr.y (mgr.24784) 6 : audit [DBG] from='client.14913 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:01.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: cluster 2023-07-20T15:09:00.028856+0000 mgr.y (mgr.24784) 7 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:01.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: audit 2023-07-20T15:09:00.383409+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:01.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: audit 2023-07-20T15:09:00.383828+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:01.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: audit 2023-07-20T15:09:00.384176+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:01.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: audit 2023-07-20T15:09:00.384485+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:01.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: audit 2023-07-20T15:09:00.384800+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:01.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: audit 2023-07-20T15:09:00.385097+0000 mon.c (mon.1) 120 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:01.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: audit 2023-07-20T15:09:00.385403+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:01.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: audit 2023-07-20T15:09:00.385691+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:01.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: audit 2023-07-20T15:09:00.385979+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:01.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: audit 2023-07-20T15:09:00.387574+0000 mon.c (mon.1) 124 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:01.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: audit 2023-07-20T15:09:00.387807+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:01.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: audit 2023-07-20T15:09:00.390877+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2023-07-20T15:09:01.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: audit 2023-07-20T15:09:00.396277+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:01.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: audit 2023-07-20T15:09:00.397193+0000 mon.c (mon.1) 126 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:01.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: audit 2023-07-20T15:09:00.397432+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:01.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[108361]: audit 2023-07-20T15:09:00.417784+0000 mgr.y (mgr.24784) 8 : audit [DBG] from='client.24829 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:01.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: audit 2023-07-20T15:08:59.686673+0000 mgr.y (mgr.24784) 6 : audit [DBG] from='client.14913 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:01.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: cluster 2023-07-20T15:09:00.028856+0000 mgr.y (mgr.24784) 7 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:01.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: audit 2023-07-20T15:09:00.383409+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:01.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: audit 2023-07-20T15:09:00.383828+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:01.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: audit 2023-07-20T15:09:00.384176+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:01.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: audit 2023-07-20T15:09:00.384485+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:01.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: audit 2023-07-20T15:09:00.384800+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:01.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: audit 2023-07-20T15:09:00.385097+0000 mon.c (mon.1) 120 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:01.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: audit 2023-07-20T15:09:00.385403+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:01.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: audit 2023-07-20T15:09:00.385691+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:01.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: audit 2023-07-20T15:09:00.385979+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:01.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: audit 2023-07-20T15:09:00.387574+0000 mon.c (mon.1) 124 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:01.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: audit 2023-07-20T15:09:00.387807+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:01.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: audit 2023-07-20T15:09:00.390877+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2023-07-20T15:09:01.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: audit 2023-07-20T15:09:00.396277+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:01.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: audit 2023-07-20T15:09:00.397193+0000 mon.c (mon.1) 126 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:01.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: audit 2023-07-20T15:09:00.397432+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:01.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:01 smithi029 bash[104935]: audit 2023-07-20T15:09:00.417784+0000 mgr.y (mgr.24784) 8 : audit [DBG] from='client.24829 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:02.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:02 smithi178 bash[104918]: cephadm 2023-07-20T15:09:01.371929+0000 mgr.y (mgr.24784) 9 : cephadm [INF] Upgrade: Updating mgr.x 2023-07-20T15:09:02.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:02 smithi178 bash[104918]: audit 2023-07-20T15:09:01.372378+0000 mon.c (mon.1) 127 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:09:02.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:02 smithi178 bash[104918]: audit 2023-07-20T15:09:01.372762+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:09:02.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:02 smithi178 bash[104918]: audit 2023-07-20T15:09:01.373828+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-20T15:09:02.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:02 smithi178 bash[104918]: audit 2023-07-20T15:09:01.374759+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:02.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:02 smithi178 bash[104918]: cephadm 2023-07-20T15:09:01.375521+0000 mgr.y (mgr.24784) 10 : cephadm [INF] Deploying daemon mgr.x on smithi178 2023-07-20T15:09:02.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:02 smithi178 bash[104918]: audit 2023-07-20T15:09:01.376018+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2023-07-20T15:09:02.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:02 smithi029 bash[108361]: cephadm 2023-07-20T15:09:01.371929+0000 mgr.y (mgr.24784) 9 : cephadm [INF] Upgrade: Updating mgr.x 2023-07-20T15:09:02.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:02 smithi029 bash[108361]: audit 2023-07-20T15:09:01.372378+0000 mon.c (mon.1) 127 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:09:02.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:02 smithi029 bash[108361]: audit 2023-07-20T15:09:01.372762+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:09:02.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:02 smithi029 bash[108361]: audit 2023-07-20T15:09:01.373828+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-20T15:09:02.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:02 smithi029 bash[108361]: audit 2023-07-20T15:09:01.374759+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:02.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:02 smithi029 bash[108361]: cephadm 2023-07-20T15:09:01.375521+0000 mgr.y (mgr.24784) 10 : cephadm [INF] Deploying daemon mgr.x on smithi178 2023-07-20T15:09:02.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:02 smithi029 bash[108361]: audit 2023-07-20T15:09:01.376018+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2023-07-20T15:09:02.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:02 smithi029 bash[104935]: cephadm 2023-07-20T15:09:01.371929+0000 mgr.y (mgr.24784) 9 : cephadm [INF] Upgrade: Updating mgr.x 2023-07-20T15:09:02.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:02 smithi029 bash[104935]: audit 2023-07-20T15:09:01.372378+0000 mon.c (mon.1) 127 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:09:02.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:02 smithi029 bash[104935]: audit 2023-07-20T15:09:01.372762+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:09:02.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:02 smithi029 bash[104935]: audit 2023-07-20T15:09:01.373828+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-20T15:09:02.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:02 smithi029 bash[104935]: audit 2023-07-20T15:09:01.374759+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:02.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:02 smithi029 bash[104935]: cephadm 2023-07-20T15:09:01.375521+0000 mgr.y (mgr.24784) 10 : cephadm [INF] Deploying daemon mgr.x on smithi178 2023-07-20T15:09:02.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:02 smithi029 bash[104935]: audit 2023-07-20T15:09:01.376018+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2023-07-20T15:09:02.923 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:02 smithi178 systemd[1]: Stopping Ceph mgr.x for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:09:03.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:03 smithi029 bash[104935]: cluster 2023-07-20T15:09:02.029743+0000 mgr.y (mgr.24784) 11 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:03.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:03 smithi029 bash[108361]: cluster 2023-07-20T15:09:02.029743+0000 mgr.y (mgr.24784) 11 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:03.672 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:03 smithi178 bash[104918]: cluster 2023-07-20T15:09:02.029743+0000 mgr.y (mgr.24784) 11 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:05.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:05 smithi029 bash[104935]: cluster 2023-07-20T15:09:04.030254+0000 mgr.y (mgr.24784) 12 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:05.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:05 smithi029 bash[108361]: cluster 2023-07-20T15:09:04.030254+0000 mgr.y (mgr.24784) 12 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:05.672 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:05 smithi178 bash[104918]: cluster 2023-07-20T15:09:04.030254+0000 mgr.y (mgr.24784) 12 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:07.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:07 smithi029 bash[104935]: cluster 2023-07-20T15:09:06.030755+0000 mgr.y (mgr.24784) 13 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:07.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:07 smithi029 bash[108361]: cluster 2023-07-20T15:09:06.030755+0000 mgr.y (mgr.24784) 13 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:07.453 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:09:06 smithi029 bash[129394]: ts=2023-07-20T15:09:06.954Z caller=notify.go:732 level=warn component=dispatcher receiver=web.hook integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"http://127.0.0.1:5001/\": dial tcp 127.0.0.1:5001: connect: connection refused" 2023-07-20T15:09:07.672 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:07 smithi178 bash[104918]: cluster 2023-07-20T15:09:06.030755+0000 mgr.y (mgr.24784) 13 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:09.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:09 smithi029 bash[108361]: cluster 2023-07-20T15:09:08.031480+0000 mgr.y (mgr.24784) 14 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:09.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:09 smithi029 bash[104935]: cluster 2023-07-20T15:09:08.031480+0000 mgr.y (mgr.24784) 14 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:09.672 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:09 smithi178 bash[104918]: cluster 2023-07-20T15:09:08.031480+0000 mgr.y (mgr.24784) 14 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:11.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:10 smithi029 bash[104935]: cluster 2023-07-20T15:09:10.031881+0000 mgr.y (mgr.24784) 15 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:11.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:10 smithi029 bash[108361]: cluster 2023-07-20T15:09:10.031881+0000 mgr.y (mgr.24784) 15 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:11.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:10 smithi178 bash[104918]: cluster 2023-07-20T15:09:10.031881+0000 mgr.y (mgr.24784) 15 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:12.904 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:12 smithi178 bash[123262]: time="2023-07-20T15:09:12Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr.x in 10 seconds, resorting to SIGKILL" 2023-07-20T15:09:13.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:13 smithi178 bash[104918]: cluster 2023-07-20T15:09:12.032542+0000 mgr.y (mgr.24784) 16 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:13.173 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:12 smithi178 bash[123262]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr.x 2023-07-20T15:09:13.173 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:13 smithi178 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.x.service: Main process exited, code=exited, status=137/n/a 2023-07-20T15:09:13.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:13 smithi029 bash[108361]: cluster 2023-07-20T15:09:12.032542+0000 mgr.y (mgr.24784) 16 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:13.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:13 smithi029 bash[104935]: cluster 2023-07-20T15:09:12.032542+0000 mgr.y (mgr.24784) 16 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:13.482 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:13 smithi178 bash[123320]: Error: no container with name or ID "ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr.x" found: no such container 2023-07-20T15:09:13.901 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:13 smithi178 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.x.service: Failed with result 'exit-code'. 2023-07-20T15:09:13.901 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:13 smithi178 systemd[1]: Stopped Ceph mgr.x for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:09:13.901 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:13 smithi178 systemd[1]: Starting Ceph mgr.x for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:09:14.423 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:13 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:13.982+0000 7fc6d25b1700 1 -- 172.21.15.178:0/2190833209 <== mon.2 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557f429f64e0 con 0x557f429cb000 2023-07-20T15:09:14.423 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:13 smithi178 bash[123460]: 12901326ede7a6db51877692a9221d8a606213c7a5dd6f3f05f6e8b7b6f4fc94 2023-07-20T15:09:14.423 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:13 smithi178 systemd[1]: Started Ceph mgr.x for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:09:14.424 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:14 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:14.112+0000 7fc6e2b97680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T15:09:14.424 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:14 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:14.198+0000 7fc6e2b97680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T15:09:14.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:14 smithi178 bash[104918]: audit 2023-07-20T15:09:14.033169+0000 mon.c (mon.1) 131 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:14.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:14 smithi178 bash[104918]: audit 2023-07-20T15:09:14.033761+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:14.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:14 smithi178 bash[104918]: audit 2023-07-20T15:09:14.037649+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:09:14.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:14 smithi178 bash[104918]: audit 2023-07-20T15:09:14.038821+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:14.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:14 smithi178 bash[104918]: audit 2023-07-20T15:09:14.040700+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:09:14.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:14 smithi029 bash[108361]: audit 2023-07-20T15:09:14.033169+0000 mon.c (mon.1) 131 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:14.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:14 smithi029 bash[104935]: audit 2023-07-20T15:09:14.033169+0000 mon.c (mon.1) 131 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:14.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:14 smithi029 bash[108361]: audit 2023-07-20T15:09:14.033761+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:14.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:14 smithi029 bash[108361]: audit 2023-07-20T15:09:14.037649+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:09:14.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:14 smithi029 bash[108361]: audit 2023-07-20T15:09:14.038821+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:14.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:14 smithi029 bash[108361]: audit 2023-07-20T15:09:14.040700+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:09:14.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:14 smithi029 bash[104935]: audit 2023-07-20T15:09:14.033761+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:14.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:14 smithi029 bash[104935]: audit 2023-07-20T15:09:14.037649+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 218942668, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091562Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83089162, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091782Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 77636567, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.091872Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 68922900, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092007Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80813752, \"cpu_percentage\": \"0.65%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092083Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 37392220, \"cpu_percentage\": \"0.95%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092151Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 10989076, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092215Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33135001, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:00.092298Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57073991, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:00.092362Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:09:14.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:14 smithi029 bash[104935]: audit 2023-07-20T15:09:14.038821+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:14.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:14 smithi029 bash[104935]: audit 2023-07-20T15:09:14.040700+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:09:14.922 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:14 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:14.619+0000 7fc6e2b97680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T15:09:15.422 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:15 smithi178 bash[104918]: cluster 2023-07-20T15:09:14.033015+0000 mgr.y (mgr.24784) 17 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:15.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:15 smithi029 bash[104935]: cluster 2023-07-20T15:09:14.033015+0000 mgr.y (mgr.24784) 17 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:15.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:15 smithi029 bash[108361]: cluster 2023-07-20T15:09:14.033015+0000 mgr.y (mgr.24784) 17 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:15.845 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:15 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:15.434+0000 7fc6e2b97680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T15:09:15.845 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:15 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:15.544+0000 7fc6e2b97680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T15:09:16.172 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:15 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:15.796+0000 7fc6e2b97680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T15:09:17.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:17 smithi178 bash[104918]: cluster 2023-07-20T15:09:16.033585+0000 mgr.y (mgr.24784) 18 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:17.173 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:16 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:16.867+0000 7fc6e2b97680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T15:09:17.173 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:17 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:17.009+0000 7fc6e2b97680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T15:09:17.173 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:17 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:17.091+0000 7fc6e2b97680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T15:09:17.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:17 smithi029 bash[104935]: cluster 2023-07-20T15:09:16.033585+0000 mgr.y (mgr.24784) 18 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:17.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:17 smithi029 bash[108361]: cluster 2023-07-20T15:09:16.033585+0000 mgr.y (mgr.24784) 18 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:17.455 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:17 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:17.191+0000 7fc6e2b97680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T15:09:17.718 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:17 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:17.406+0000 7fc6e2b97680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T15:09:18.149 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:17 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:17.717+0000 7fc6e2b97680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T15:09:18.150 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:17 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:17.834+0000 7fc6e2b97680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T15:09:18.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.808407+0000 mon.c (mon.1) 134 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 227331276, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806030Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"12901326ede7\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44837109, \"cpu_percentage\": \"109.96%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:17.806225Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:09:13.718116Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 84274053, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806349Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78464942, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806439Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 69730304, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806525Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 81788928, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806607Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 37528535, \"cpu_percentage\": \"0.80%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806688Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11597250, \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806770Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33407631, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806851Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57147392, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806931Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:17.807082Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:18.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.808992+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 227331276, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806030Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"12901326ede7\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44837109, \"cpu_percentage\": \"109.96%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:17.806225Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:09:13.718116Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 84274053, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806349Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78464942, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806439Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 69730304, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806525Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 81788928, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806607Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 37528535, \"cpu_percentage\": \"0.80%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806688Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11597250, \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806770Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33407631, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806851Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57147392, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806931Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:17.807082Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:18.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.812552+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 227331276, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806030Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"12901326ede7\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44837109, \"cpu_percentage\": \"109.96%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:17.806225Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:09:13.718116Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 84274053, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806349Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78464942, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806439Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 69730304, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806525Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 81788928, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806607Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 37528535, \"cpu_percentage\": \"0.80%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806688Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11597250, \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806770Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33407631, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806851Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57147392, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806931Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:17.807082Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:09:18.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.814642+0000 mon.c (mon.1) 135 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:18.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.814966+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:18.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.817843+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2023-07-20T15:09:18.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.823852+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:18.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.824885+0000 mon.c (mon.1) 137 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:18.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.825173+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:18.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.826720+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:09:18.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.827684+0000 mon.c (mon.1) 139 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr"}]: dispatch 2023-07-20T15:09:18.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.827940+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr"}]: dispatch 2023-07-20T15:09:18.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.831759+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr"}]': finished 2023-07-20T15:09:18.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.832734+0000 mon.c (mon.1) 140 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2023-07-20T15:09:18.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.833006+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2023-07-20T15:09:18.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.836668+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2023-07-20T15:09:18.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.837569+0000 mon.c (mon.1) 141 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2023-07-20T15:09:18.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.837834+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2023-07-20T15:09:18.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.841410+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2023-07-20T15:09:18.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.842726+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-07-20T15:09:18.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:18 smithi178 bash[104918]: audit 2023-07-20T15:09:17.843561+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2023-07-20T15:09:18.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.808407+0000 mon.c (mon.1) 134 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 227331276, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806030Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"12901326ede7\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44837109, \"cpu_percentage\": \"109.96%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:17.806225Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:09:13.718116Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 84274053, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806349Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78464942, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806439Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 69730304, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806525Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 81788928, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806607Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 37528535, \"cpu_percentage\": \"0.80%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806688Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11597250, \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806770Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33407631, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806851Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57147392, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806931Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:17.807082Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:18.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.808407+0000 mon.c (mon.1) 134 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 227331276, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806030Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"12901326ede7\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44837109, \"cpu_percentage\": \"109.96%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:17.806225Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:09:13.718116Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 84274053, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806349Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78464942, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806439Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 69730304, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806525Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 81788928, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806607Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 37528535, \"cpu_percentage\": \"0.80%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806688Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11597250, \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806770Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33407631, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806851Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57147392, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806931Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:17.807082Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:18.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.808992+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 227331276, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806030Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"12901326ede7\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44837109, \"cpu_percentage\": \"109.96%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:17.806225Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:09:13.718116Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 84274053, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806349Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78464942, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806439Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 69730304, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806525Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 81788928, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806607Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 37528535, \"cpu_percentage\": \"0.80%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806688Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11597250, \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806770Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33407631, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806851Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57147392, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806931Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:17.807082Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:18.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.808992+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 227331276, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806030Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"12901326ede7\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44837109, \"cpu_percentage\": \"109.96%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:17.806225Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:09:13.718116Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 84274053, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806349Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78464942, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806439Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 69730304, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806525Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 81788928, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806607Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 37528535, \"cpu_percentage\": \"0.80%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806688Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11597250, \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806770Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33407631, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806851Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57147392, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806931Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:17.807082Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:18.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.812552+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 227331276, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806030Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"12901326ede7\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44837109, \"cpu_percentage\": \"109.96%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:17.806225Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:09:13.718116Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 84274053, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806349Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78464942, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806439Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 69730304, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806525Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 81788928, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806607Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 37528535, \"cpu_percentage\": \"0.80%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806688Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11597250, \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806770Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33407631, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806851Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57147392, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806931Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:17.807082Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:09:18.455 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.814642+0000 mon.c (mon.1) 135 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:18.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.814966+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:18.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.817843+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2023-07-20T15:09:18.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.823852+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:18.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.824885+0000 mon.c (mon.1) 137 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:18.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.825173+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:18.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.826720+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:09:18.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.827684+0000 mon.c (mon.1) 139 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr"}]: dispatch 2023-07-20T15:09:18.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.827940+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr"}]: dispatch 2023-07-20T15:09:18.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.831759+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr"}]': finished 2023-07-20T15:09:18.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.812552+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 227331276, \"cpu_percentage\": \"1.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806030Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"12901326ede7\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 44837109, \"cpu_percentage\": \"109.96%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:17.806225Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:09:13.718116Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 84274053, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806349Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 78464942, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806439Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 69730304, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806525Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 81788928, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806607Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\", \"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\"], \"memory_usage\": 37528535, \"cpu_percentage\": \"0.80%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806688Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 11597250, \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806770Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33407631, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806851Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57147392, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:17.806931Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:17.807082Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2023-07-20T15:09:18.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.814642+0000 mon.c (mon.1) 135 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:18.457 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.814966+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:18.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.817843+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2023-07-20T15:09:18.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.823852+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:18.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.824885+0000 mon.c (mon.1) 137 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:18.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.825173+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:18.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.826720+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:09:18.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.827684+0000 mon.c (mon.1) 139 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr"}]: dispatch 2023-07-20T15:09:18.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.827940+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr"}]: dispatch 2023-07-20T15:09:18.459 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.831759+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mgr"}]': finished 2023-07-20T15:09:18.459 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.832734+0000 mon.c (mon.1) 140 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2023-07-20T15:09:18.459 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.833006+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2023-07-20T15:09:18.459 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.836668+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2023-07-20T15:09:18.459 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.837569+0000 mon.c (mon.1) 141 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2023-07-20T15:09:18.460 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.837834+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2023-07-20T15:09:18.460 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.841410+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2023-07-20T15:09:18.460 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.842726+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-07-20T15:09:18.460 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[108361]: audit 2023-07-20T15:09:17.843561+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2023-07-20T15:09:18.460 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.832734+0000 mon.c (mon.1) 140 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2023-07-20T15:09:18.461 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.833006+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2023-07-20T15:09:18.461 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.836668+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2023-07-20T15:09:18.461 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.837569+0000 mon.c (mon.1) 141 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2023-07-20T15:09:18.461 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.837834+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2023-07-20T15:09:18.461 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.841410+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2023-07-20T15:09:18.461 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.842726+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-07-20T15:09:18.462 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:18 smithi029 bash[104935]: audit 2023-07-20T15:09:17.843561+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2023-07-20T15:09:18.704 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:18 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:18.571+0000 7fc6e2b97680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-20T15:09:18.981 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:18 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:18.654+0000 7fc6e2b97680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T15:09:18.982 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:18 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:18.748+0000 7fc6e2b97680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T15:09:19.245 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:18 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:18.932+0000 7fc6e2b97680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T15:09:19.246 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:19 smithi178 bash[104918]: cephadm 2023-07-20T15:09:17.827444+0000 mgr.y (mgr.24784) 19 : cephadm [INF] Upgrade: Setting container_image for all mgr 2023-07-20T15:09:19.246 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:19 smithi178 bash[104918]: cephadm 2023-07-20T15:09:17.844130+0000 mgr.y (mgr.24784) 20 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2023-07-20T15:09:19.246 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:19 smithi178 bash[104918]: cluster 2023-07-20T15:09:18.034163+0000 mgr.y (mgr.24784) 21 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:19.246 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:19 smithi178 bash[104918]: audit 2023-07-20T15:09:18.783268+0000 mon.c (mon.1) 144 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.a"}]: dispatch 2023-07-20T15:09:19.246 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:19 smithi178 bash[104918]: audit 2023-07-20T15:09:18.783585+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.a"}]: dispatch 2023-07-20T15:09:19.246 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:19 smithi178 bash[104918]: audit 2023-07-20T15:09:18.787334+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.a"}]': finished 2023-07-20T15:09:19.246 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:19 smithi178 bash[104918]: audit 2023-07-20T15:09:18.788144+0000 mon.c (mon.1) 145 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:19.247 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:19 smithi178 bash[104918]: audit 2023-07-20T15:09:18.788707+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:19.247 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:19 smithi178 bash[104918]: audit 2023-07-20T15:09:18.789249+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:19.247 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:19 smithi178 bash[104918]: audit 2023-07-20T15:09:18.790114+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2023-07-20T15:09:19.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[108361]: cephadm 2023-07-20T15:09:17.827444+0000 mgr.y (mgr.24784) 19 : cephadm [INF] Upgrade: Setting container_image for all mgr 2023-07-20T15:09:19.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[108361]: cephadm 2023-07-20T15:09:17.844130+0000 mgr.y (mgr.24784) 20 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2023-07-20T15:09:19.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[108361]: cluster 2023-07-20T15:09:18.034163+0000 mgr.y (mgr.24784) 21 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:19.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[108361]: audit 2023-07-20T15:09:18.783268+0000 mon.c (mon.1) 144 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.a"}]: dispatch 2023-07-20T15:09:19.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[108361]: audit 2023-07-20T15:09:18.783585+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.a"}]: dispatch 2023-07-20T15:09:19.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[108361]: audit 2023-07-20T15:09:18.787334+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.a"}]': finished 2023-07-20T15:09:19.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[108361]: audit 2023-07-20T15:09:18.788144+0000 mon.c (mon.1) 145 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:19.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[108361]: audit 2023-07-20T15:09:18.788707+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:19.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[108361]: audit 2023-07-20T15:09:18.789249+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:19.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[108361]: audit 2023-07-20T15:09:18.790114+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2023-07-20T15:09:19.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[104935]: cephadm 2023-07-20T15:09:17.827444+0000 mgr.y (mgr.24784) 19 : cephadm [INF] Upgrade: Setting container_image for all mgr 2023-07-20T15:09:19.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[104935]: cephadm 2023-07-20T15:09:17.844130+0000 mgr.y (mgr.24784) 20 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2023-07-20T15:09:19.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[104935]: cluster 2023-07-20T15:09:18.034163+0000 mgr.y (mgr.24784) 21 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:19.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[104935]: audit 2023-07-20T15:09:18.783268+0000 mon.c (mon.1) 144 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.a"}]: dispatch 2023-07-20T15:09:19.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[104935]: audit 2023-07-20T15:09:18.783585+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.a"}]: dispatch 2023-07-20T15:09:19.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[104935]: audit 2023-07-20T15:09:18.787334+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.a"}]': finished 2023-07-20T15:09:19.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[104935]: audit 2023-07-20T15:09:18.788144+0000 mon.c (mon.1) 145 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:19.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[104935]: audit 2023-07-20T15:09:18.788707+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:19.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[104935]: audit 2023-07-20T15:09:18.789249+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:19.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[104935]: audit 2023-07-20T15:09:18.790114+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2023-07-20T15:09:19.513 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:19 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:19.196+0000 7fc6e2b97680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T15:09:19.513 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:19 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:19.330+0000 7fc6e2b97680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T15:09:19.773 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:19 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:19.464+0000 7fc6e2b97680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T15:09:19.773 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:19 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:19.638+0000 7fc6e2b97680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T15:09:20.158 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:19 smithi029 systemd[1]: Stopping Ceph mon.a for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:09:20.158 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[104935]: debug 2023-07-20T15:09:19.865+0000 7efedb8f1700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T15:09:20.158 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:19 smithi029 bash[104935]: debug 2023-07-20T15:09:19.865+0000 7efedb8f1700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-07-20T15:09:20.172 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:19 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:19.724+0000 7fc6e2b97680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T15:09:20.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:20 smithi029 bash[131923]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon.a 2023-07-20T15:09:21.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:20 smithi029 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.a.service: Succeeded. 2023-07-20T15:09:21.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:20 smithi029 systemd[1]: Stopped Ceph mon.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:09:21.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:20 smithi029 systemd[1]: Starting Ceph mon.a for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:09:21.702 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.271+0000 7f03044ff880 0 set uid:gid to 167:167 (ceph:ceph) 2023-07-20T15:09:21.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.271+0000 7f03044ff880 0 ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable), process ceph-mon, pid 7 2023-07-20T15:09:21.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.271+0000 7f03044ff880 0 pidfile_write: ignore empty --pid-file 2023-07-20T15:09:21.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.275+0000 7f03044ff880 0 load: jerasure load: lrc load: isa 2023-07-20T15:09:21.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 bash[132104]: 0c199917352e2a5aee0e2719c632b859c72d8b085aa62300080fc63709bc640e 2023-07-20T15:09:21.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: RocksDB version: 6.8.1 2023-07-20T15:09:21.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-07-20T15:09:21.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Compile date Jul 18 2023 2023-07-20T15:09:21.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: DB SUMMARY 2023-07-20T15:09:21.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: CURRENT file: CURRENT 2023-07-20T15:09:21.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.705 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: IDENTITY file: IDENTITY 2023-07-20T15:09:21.705 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.705 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: MANIFEST file: MANIFEST-000008 size: 366 Bytes 2023-07-20T15:09:21.705 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.705 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000016.sst 2023-07-20T15:09:21.705 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.705 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000014.log size: 26028928 ; 2023-07-20T15:09:21.706 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.706 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.error_if_exists: 0 2023-07-20T15:09:21.706 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.create_if_missing: 0 2023-07-20T15:09:21.706 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.paranoid_checks: 1 2023-07-20T15:09:21.706 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.env: 0x564d1ff19080 2023-07-20T15:09:21.708 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.fs: Posix File System 2023-07-20T15:09:21.708 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.info_log: 0x564d20901960 2023-07-20T15:09:21.708 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_file_opening_threads: 16 2023-07-20T15:09:21.708 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.statistics: (nil) 2023-07-20T15:09:21.708 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.use_fsync: 0 2023-07-20T15:09:21.708 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_log_file_size: 0 2023-07-20T15:09:21.709 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-20T15:09:21.709 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.log_file_time_to_roll: 0 2023-07-20T15:09:21.709 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.keep_log_file_num: 1000 2023-07-20T15:09:21.709 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.recycle_log_file_num: 0 2023-07-20T15:09:21.709 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.allow_fallocate: 1 2023-07-20T15:09:21.710 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.allow_mmap_reads: 0 2023-07-20T15:09:21.710 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.allow_mmap_writes: 0 2023-07-20T15:09:21.710 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.use_direct_reads: 0 2023-07-20T15:09:21.710 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-20T15:09:21.710 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.create_missing_column_families: 0 2023-07-20T15:09:21.710 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.db_log_dir: 2023-07-20T15:09:21.711 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2023-07-20T15:09:21.711 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.table_cache_numshardbits: 6 2023-07-20T15:09:21.711 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_subcompactions: 1 2023-07-20T15:09:21.711 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_background_flushes: -1 2023-07-20T15:09:21.711 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-07-20T15:09:21.711 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-07-20T15:09:21.711 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-07-20T15:09:21.711 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-20T15:09:21.712 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-07-20T15:09:21.712 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.advise_random_on_open: 1 2023-07-20T15:09:21.712 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.db_write_buffer_size: 0 2023-07-20T15:09:21.712 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.write_buffer_manager: 0x564d215fc1b0 2023-07-20T15:09:21.712 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-20T15:09:21.712 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-07-20T15:09:21.712 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-20T15:09:21.712 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.use_adaptive_mutex: 0 2023-07-20T15:09:21.713 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.rate_limiter: (nil) 2023-07-20T15:09:21.713 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-20T15:09:21.713 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.wal_recovery_mode: 2 2023-07-20T15:09:21.713 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.enable_thread_tracking: 0 2023-07-20T15:09:21.713 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.enable_pipelined_write: 0 2023-07-20T15:09:21.713 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.unordered_write: 0 2023-07-20T15:09:21.713 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-20T15:09:21.713 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-20T15:09:21.714 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-20T15:09:21.714 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-20T15:09:21.714 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.row_cache: None 2023-07-20T15:09:21.714 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.wal_filter: None 2023-07-20T15:09:21.714 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-20T15:09:21.714 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.allow_ingest_behind: 0 2023-07-20T15:09:21.714 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.preserve_deletes: 0 2023-07-20T15:09:21.715 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.two_write_queues: 0 2023-07-20T15:09:21.715 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.manual_wal_flush: 0 2023-07-20T15:09:21.715 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.atomic_flush: 0 2023-07-20T15:09:21.715 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-20T15:09:21.715 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.persist_stats_to_disk: 0 2023-07-20T15:09:21.715 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-07-20T15:09:21.715 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.log_readahead_size: 0 2023-07-20T15:09:21.716 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2023-07-20T15:09:21.716 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_background_jobs: 2 2023-07-20T15:09:21.716 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_background_compactions: -1 2023-07-20T15:09:21.720 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-20T15:09:21.720 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-20T15:09:21.720 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.delayed_write_rate : 16777216 2023-07-20T15:09:21.720 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_total_wal_size: 0 2023-07-20T15:09:21.721 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-20T15:09:21.721 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.stats_dump_period_sec: 600 2023-07-20T15:09:21.721 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.stats_persist_period_sec: 600 2023-07-20T15:09:21.721 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-20T15:09:21.721 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_open_files: -1 2023-07-20T15:09:21.721 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.bytes_per_sync: 0 2023-07-20T15:09:21.721 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-07-20T15:09:21.721 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-07-20T15:09:21.722 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.compaction_readahead_size: 0 2023-07-20T15:09:21.722 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Compression algorithms supported: 2023-07-20T15:09:21.722 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-20T15:09:21.722 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: kZSTD supported: 0 2023-07-20T15:09:21.722 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: kXpressCompression supported: 0 2023-07-20T15:09:21.722 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: kLZ4HCCompression supported: 1 2023-07-20T15:09:21.722 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: kLZ4Compression supported: 1 2023-07-20T15:09:21.722 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: kBZip2Compression supported: 0 2023-07-20T15:09:21.723 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: kZlibCompression supported: 1 2023-07-20T15:09:21.723 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: kSnappyCompression supported: 1 2023-07-20T15:09:21.723 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-07-20T15:09:21.723 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 2023-07-20T15:09:21.723 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.723 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2023-07-20T15:09:21.723 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.723 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-20T15:09:21.724 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.merge_operator: 2023-07-20T15:09:21.724 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.compaction_filter: None 2023-07-20T15:09:21.724 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.compaction_filter_factory: None 2023-07-20T15:09:21.724 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-07-20T15:09:21.724 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.table_factory: BlockBasedTable 2023-07-20T15:09:21.725 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564d208b1d18) 2023-07-20T15:09:21.725 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cache_index_and_filter_blocks: 1 2023-07-20T15:09:21.725 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cache_index_and_filter_blocks_with_high_priority: 0 2023-07-20T15:09:21.725 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-20T15:09:21.725 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: pin_top_level_index_and_filter: 1 2023-07-20T15:09:21.725 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: index_type: 0 2023-07-20T15:09:21.725 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: data_block_index_type: 0 2023-07-20T15:09:21.726 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: index_shortening: 1 2023-07-20T15:09:21.726 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: data_block_hash_table_util_ratio: 0.750000 2023-07-20T15:09:21.726 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: hash_index_allow_collision: 1 2023-07-20T15:09:21.726 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: checksum: 1 2023-07-20T15:09:21.726 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: no_block_cache: 0 2023-07-20T15:09:21.726 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: block_cache: 0x564d208e6f10 2023-07-20T15:09:21.727 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: block_cache_name: BinnedLRUCache 2023-07-20T15:09:21.727 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: block_cache_options: 2023-07-20T15:09:21.727 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: capacity : 536870912 2023-07-20T15:09:21.727 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: num_shard_bits : 4 2023-07-20T15:09:21.727 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: strict_capacity_limit : 0 2023-07-20T15:09:21.727 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: high_pri_pool_ratio: 0.000 2023-07-20T15:09:21.728 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: block_cache_compressed: (nil) 2023-07-20T15:09:21.728 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: persistent_cache: (nil) 2023-07-20T15:09:21.728 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: block_size: 4096 2023-07-20T15:09:21.728 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: block_size_deviation: 10 2023-07-20T15:09:21.728 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: block_restart_interval: 16 2023-07-20T15:09:21.728 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: index_block_restart_interval: 1 2023-07-20T15:09:21.728 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: metadata_block_size: 4096 2023-07-20T15:09:21.729 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: partition_filters: 0 2023-07-20T15:09:21.729 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: use_delta_encoding: 1 2023-07-20T15:09:21.729 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: filter_policy: rocksdb.BuiltinBloomFilter 2023-07-20T15:09:21.729 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: whole_key_filtering: 1 2023-07-20T15:09:21.729 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: verify_compression: 0 2023-07-20T15:09:21.729 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: read_amp_bytes_per_bit: 0 2023-07-20T15:09:21.729 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: format_version: 2 2023-07-20T15:09:21.729 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: enable_index_compression: 1 2023-07-20T15:09:21.730 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: block_align: 0 2023-07-20T15:09:21.730 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.730 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.write_buffer_size: 33554432 2023-07-20T15:09:21.730 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_write_buffer_number: 2 2023-07-20T15:09:21.730 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.compression: NoCompression 2023-07-20T15:09:21.730 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.bottommost_compression: Disabled 2023-07-20T15:09:21.730 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.prefix_extractor: nullptr 2023-07-20T15:09:21.730 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-20T15:09:21.731 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.num_levels: 7 2023-07-20T15:09:21.731 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-20T15:09:21.731 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-20T15:09:21.731 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-07-20T15:09:21.731 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-20T15:09:21.731 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-20T15:09:21.731 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-20T15:09:21.731 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-20T15:09:21.732 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-20T15:09:21.732 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-20T15:09:21.732 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.compression_opts.window_bits: -14 2023-07-20T15:09:21.732 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.compression_opts.level: 32767 2023-07-20T15:09:21.732 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.compression_opts.strategy: 0 2023-07-20T15:09:21.732 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-20T15:09:21.732 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-20T15:09:21.733 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.compression_opts.enabled: false 2023-07-20T15:09:21.733 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-20T15:09:21.733 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-20T15:09:21.733 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-20T15:09:21.733 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.target_file_size_base: 67108864 2023-07-20T15:09:21.733 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.target_file_size_multiplier: 1 2023-07-20T15:09:21.733 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-20T15:09:21.733 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-20T15:09:21.734 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-20T15:09:21.734 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-20T15:09:21.734 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-20T15:09:21.734 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-20T15:09:21.734 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-20T15:09:21.734 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-20T15:09:21.735 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-20T15:09:21.735 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-20T15:09:21.735 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.276+0000 7f03044ff880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-20T15:09:21.735 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-20T15:09:21.735 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.arena_block_size: 4194304 2023-07-20T15:09:21.735 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-20T15:09:21.735 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-20T15:09:21.735 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-07-20T15:09:21.736 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.disable_auto_compactions: 0 2023-07-20T15:09:21.736 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-20T15:09:21.736 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-20T15:09:21.736 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-20T15:09:21.736 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-20T15:09:21.737 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-20T15:09:21.737 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-20T15:09:21.737 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-20T15:09:21.737 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-20T15:09:21.737 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-20T15:09:21.737 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-20T15:09:21.737 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.table_properties_collectors: 2023-07-20T15:09:21.737 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.inplace_update_support: 0 2023-07-20T15:09:21.738 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-07-20T15:09:21.738 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-20T15:09:21.738 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-20T15:09:21.738 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.memtable_huge_page_size: 0 2023-07-20T15:09:21.738 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.bloom_locality: 0 2023-07-20T15:09:21.738 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.max_successive_merges: 0 2023-07-20T15:09:21.738 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-07-20T15:09:21.738 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.paranoid_file_checks: 0 2023-07-20T15:09:21.739 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.force_consistency_checks: 0 2023-07-20T15:09:21.739 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.report_bg_io_stats: 0 2023-07-20T15:09:21.739 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.ttl: 2592000 2023-07-20T15:09:21.739 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-07-20T15:09:21.739 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 18, last_sequence is 6316, log_number is 14,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-07-20T15:09:21.739 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.739 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 14 2023-07-20T15:09:21.740 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.740 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689865761279073, "job": 1, "event": "recovery_started", "log_files": [14]} 2023-07-20T15:09:21.740 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.277+0000 7f03044ff880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #14 mode 2 2023-07-20T15:09:21.740 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 systemd[1]: Started Ceph mon.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:09:21.740 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.297+0000 7f03044ff880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-07-20T15:09:21.740 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.323+0000 7f03044ff880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689865761324237, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 18, "file_size": 25770227, "table_properties": {"data_size": 25754890, "index_size": 12913, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 1605, "raw_key_size": 12275, "raw_average_key_size": 20, "raw_value_size": 25736858, "raw_average_value_size": 43182, "num_data_blocks": 408, "num_entries": 596, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1689865761, "oldest_key_time": 3, "file_creation_time": 0}} 2023-07-20T15:09:21.740 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.323+0000 7f03044ff880 4 rocksdb: [version_set.cc:3826] Creating manifest 19 2023-07-20T15:09:21.740 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.741 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.323+0000 7f03044ff880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689865761324843, "job": 1, "event": "recovery_finished"} 2023-07-20T15:09:21.741 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.326+0000 7f03044ff880 4 rocksdb: DB pointer 0x564d209af800 2023-07-20T15:09:21.741 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.326+0000 7f02eb307700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2023-07-20T15:09:21.741 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.326+0000 7f02eb307700 4 rocksdb: [db_impl/db_impl.cc:851] 2023-07-20T15:09:21.741 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: ** DB Stats ** 2023-07-20T15:09:21.741 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-20T15:09:21.741 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-20T15:09:21.741 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-20T15:09:21.742 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-20T15:09:21.742 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-20T15:09:21.742 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-07-20T15:09:21.742 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-20T15:09:21.742 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.742 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: ** Compaction Stats [default] ** 2023-07-20T15:09:21.742 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T15:09:21.743 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T15:09:21.743 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: L0 1/0 24.58 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 968.7 0.03 0.00 1 0.025 0 0 2023-07-20T15:09:21.743 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: L6 1/0 50.83 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-07-20T15:09:21.743 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Sum 2/0 75.41 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 968.7 0.03 0.00 1 0.025 0 0 2023-07-20T15:09:21.743 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 968.7 0.03 0.00 1 0.025 0 0 2023-07-20T15:09:21.744 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.744 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: ** Compaction Stats [default] ** 2023-07-20T15:09:21.744 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T15:09:21.744 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T15:09:21.745 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 968.7 0.03 0.00 1 0.025 0 0 2023-07-20T15:09:21.745 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-20T15:09:21.745 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Flush(GB): cumulative 0.024, interval 0.024 2023-07-20T15:09:21.746 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-20T15:09:21.746 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: AddFile(Total Files): cumulative 0, interval 0 2023-07-20T15:09:21.746 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: AddFile(L0 Files): cumulative 0, interval 0 2023-07-20T15:09:21.746 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: AddFile(Keys): cumulative 0, interval 0 2023-07-20T15:09:21.747 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Cumulative compaction: 0.02 GB write, 498.72 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T15:09:21.747 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Interval compaction: 0.02 GB write, 498.72 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T15:09:21.747 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-20T15:09:21.747 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.748 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: ** File Read Latency Histogram By Level [default] ** 2023-07-20T15:09:21.748 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.748 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: ** Compaction Stats [default] ** 2023-07-20T15:09:21.748 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T15:09:21.748 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T15:09:21.748 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: L0 1/0 24.58 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 968.7 0.03 0.00 1 0.025 0 0 2023-07-20T15:09:21.748 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: L6 1/0 50.83 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-07-20T15:09:21.749 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Sum 2/0 75.41 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 968.7 0.03 0.00 1 0.025 0 0 2023-07-20T15:09:21.749 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-07-20T15:09:21.749 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.749 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: ** Compaction Stats [default] ** 2023-07-20T15:09:21.749 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T15:09:21.749 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T15:09:21.749 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 968.7 0.03 0.00 1 0.025 0 0 2023-07-20T15:09:21.750 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-20T15:09:21.750 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Flush(GB): cumulative 0.024, interval 0.000 2023-07-20T15:09:21.750 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-20T15:09:21.750 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: AddFile(Total Files): cumulative 0, interval 0 2023-07-20T15:09:21.750 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: AddFile(L0 Files): cumulative 0, interval 0 2023-07-20T15:09:21.750 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: AddFile(Keys): cumulative 0, interval 0 2023-07-20T15:09:21.750 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Cumulative compaction: 0.02 GB write, 498.39 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T15:09:21.750 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T15:09:21.751 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-20T15:09:21.751 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.751 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: ** File Read Latency Histogram By Level [default] ** 2023-07-20T15:09:21.751 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.751 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.326+0000 7f03044ff880 0 starting mon.a rank 0 at public addrs [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] at bind addrs [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T15:09:21.751 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.327+0000 7f03044ff880 1 mon.a@-1(???) e3 preinit fsid 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T15:09:21.751 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.327+0000 7f03044ff880 0 mon.a@-1(???).mds e1 new map 2023-07-20T15:09:21.752 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.327+0000 7f03044ff880 0 mon.a@-1(???).mds e1 print_map 2023-07-20T15:09:21.752 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: e1 2023-07-20T15:09:21.752 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: enable_multiple, ever_enabled_multiple: 0,0 2023-07-20T15:09:21.752 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-20T15:09:21.752 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: legacy client fscid: -1 2023-07-20T15:09:21.752 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.752 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: No filesystems configured 2023-07-20T15:09:21.753 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: 2023-07-20T15:09:21.753 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.328+0000 7f03044ff880 0 mon.a@-1(???).osd e77 crush map has features 3314933000852226048, adjusting msgr requires 2023-07-20T15:09:21.753 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.328+0000 7f03044ff880 0 mon.a@-1(???).osd e77 crush map has features 288514051259236352, adjusting msgr requires 2023-07-20T15:09:21.753 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.328+0000 7f03044ff880 0 mon.a@-1(???).osd e77 crush map has features 288514051259236352, adjusting msgr requires 2023-07-20T15:09:21.753 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.328+0000 7f03044ff880 0 mon.a@-1(???).osd e77 crush map has features 288514051259236352, adjusting msgr requires 2023-07-20T15:09:21.753 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:09:17.827444+0000 mgr.y (mgr.24784) 19 : cephadm [INF] Upgrade: Setting container_image for all mgr 2023-07-20T15:09:21.753 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:09:17.844130+0000 mgr.y (mgr.24784) 20 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2023-07-20T15:09:21.753 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:18.034163+0000 mgr.y (mgr.24784) 21 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:21.754 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:18.783268+0000 mon.c (mon.1) 144 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.a"}]: dispatch 2023-07-20T15:09:21.754 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:18.783585+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.a"}]: dispatch 2023-07-20T15:09:21.754 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:18.787334+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.24784 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.a"}]': finished 2023-07-20T15:09:21.754 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:18.788144+0000 mon.c (mon.1) 145 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:21.754 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:18.788707+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:21.754 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:18.789249+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:21.754 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:18.790114+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2023-07-20T15:09:21.755 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:09:21.328+0000 7f03044ff880 1 mon.a@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2023-07-20T15:09:24.702 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: ignoring --setuser ceph since I am not root 2023-07-20T15:09:24.703 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: ignoring --setgroup ceph since I am not root 2023-07-20T15:09:24.703 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:24.415+0000 7fd6babf9700 1 -- 172.21.15.29:0/2803468291 <== mon.1 v2:172.21.15.29:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e13f7244e0 con 0x55e13f6fb000 2023-07-20T15:09:24.703 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:24.547+0000 7fd6cadc1680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T15:09:24.703 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:24.633+0000 7fd6cadc1680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T15:09:24.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:20.034590+0000 mgr.y (mgr.24784) 24 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:24.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:24 smithi029 bash[108361]: cluster 2023-07-20T15:09:20.034590+0000 mgr.y (mgr.24784) 24 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:24.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:21.325683+0000 mon.c (mon.1) 149 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 442394214, \"cpu_percentage\": \"53.78%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:59.536916Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 217998950, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536995Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 76556533, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537063Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79628861, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537129Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 64298680, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537192Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79524003, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537267Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 13725859, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537333Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 19262341, \"cpu_percentage\": \"0.42%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:08:59.537395Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 56444846, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537457Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": fa 2023-07-20T15:09:24.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:24 smithi029 bash[108361]: audit 2023-07-20T15:09:21.325683+0000 mon.c (mon.1) 149 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 442394214, \"cpu_percentage\": \"53.78%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:59.536916Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 217998950, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536995Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 76556533, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537063Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79628861, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537129Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 64298680, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537192Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79524003, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537267Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 13725859, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537333Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 19262341, \"cpu_percentage\": \"0.42%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:08:59.537395Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 56444846, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537457Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:18.789697Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:24.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:24 smithi029 bash[108361]: cluster 2023-07-20T15:09:22.035403+0000 mgr.y (mgr.24784) 25 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:24.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:24 smithi029 bash[108361]: cluster 2023-07-20T15:09:24.342015+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2023-07-20T15:09:24.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:24 smithi029 bash[108361]: cluster 2023-07-20T15:09:24.343968+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-20T15:09:24.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:24 smithi029 bash[108361]: cluster 2023-07-20T15:09:24.348019+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],b=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0],c=[v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0]} removed_ranks: {} 2023-07-20T15:09:24.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:24 smithi029 bash[108361]: cluster 2023-07-20T15:09:24.348646+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2023-07-20T15:09:24.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:24 smithi029 bash[108361]: cluster 2023-07-20T15:09:24.348692+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2023-07-20T15:09:24.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:24 smithi029 bash[108361]: cluster 2023-07-20T15:09:24.349666+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e24: y(active, since 34s), standbys: x 2023-07-20T15:09:24.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:24 smithi029 bash[108361]: cluster 2023-07-20T15:09:24.358124+0000 mon.a (mon.0) 7 : cluster [DBG] Standby manager daemon x restarted 2023-07-20T15:09:24.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:24 smithi029 bash[108361]: cluster 2023-07-20T15:09:24.358190+0000 mon.a (mon.0) 8 : cluster [DBG] Standby manager daemon x started 2023-07-20T15:09:24.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:24 smithi029 bash[108361]: cluster 2023-07-20T15:09:24.358447+0000 mon.a (mon.0) 9 : cluster [DBG] mgrmap e25: y(active, since 34s), standbys: x 2023-07-20T15:09:24.707 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:24 smithi029 bash[108361]: cluster 2023-07-20T15:09:24.359401+0000 mon.a (mon.0) 10 : cluster [INF] overall HEALTH_OK 2023-07-20T15:09:24.707 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:24 smithi029 bash[108361]: audit 2023-07-20T15:09:24.364982+0000 mon.a (mon.0) 11 : audit [INF] from='mgr.24784 ' entity='' 2023-07-20T15:09:24.707 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: lse, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:18.789697Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:24.707 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:22.035403+0000 mgr.y (mgr.24784) 25 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:24.707 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:24.342015+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2023-07-20T15:09:24.708 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:24.343968+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-20T15:09:24.708 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:24.348019+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],b=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0],c=[v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0]} removed_ranks: {} 2023-07-20T15:09:24.708 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:24.348646+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2023-07-20T15:09:24.708 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:24.348692+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2023-07-20T15:09:24.708 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:24.349666+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e24: y(active, since 34s), standbys: x 2023-07-20T15:09:24.708 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:24.358124+0000 mon.a (mon.0) 7 : cluster [DBG] Standby manager daemon x restarted 2023-07-20T15:09:24.709 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:24.358190+0000 mon.a (mon.0) 8 : cluster [DBG] Standby manager daemon x started 2023-07-20T15:09:24.709 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:24.358447+0000 mon.a (mon.0) 9 : cluster [DBG] mgrmap e25: y(active, since 34s), standbys: x 2023-07-20T15:09:24.709 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:24.359401+0000 mon.a (mon.0) 10 : cluster [INF] overall HEALTH_OK 2023-07-20T15:09:24.709 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:24.364982+0000 mon.a (mon.0) 11 : audit [INF] from='mgr.24784 ' entity='' 2023-07-20T15:09:24.923 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:24 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: ignoring --setuser ceph since I am not root 2023-07-20T15:09:24.923 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:24 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: ignoring --setgroup ceph since I am not root 2023-07-20T15:09:24.923 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:24 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:24.398+0000 7f2718302700 1 -- 172.21.15.178:0/294692452 <== mon.2 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f45d4304e0 con 0x55f45d406c00 2023-07-20T15:09:24.923 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:24 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:24.530+0000 7f27284ca680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T15:09:24.924 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:24 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:24.612+0000 7f27284ca680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T15:09:24.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:24 smithi178 bash[104918]: cluster 2023-07-20T15:09:20.034590+0000 mgr.y (mgr.24784) 24 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:24.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:24 smithi178 bash[104918]: audit 2023-07-20T15:09:21.325683+0000 mon.c (mon.1) 149 : audit [INF] from='mgr.24784 172.21.15.29:0/2527575458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 442394214, \"cpu_percentage\": \"53.78%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:08:59.536916Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 217998950, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.536995Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 76556533, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537063Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79628861, \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537129Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 64298680, \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537192Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 79524003, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537267Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 13725859, \"cpu_percentage\": \"0.40%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537333Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"memory_usage\": 19262341, \"cpu_percentage\": \"0.42%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:08:59.537395Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 56444846, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:08:59.537457Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:18.789697Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:24.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:24 smithi178 bash[104918]: cluster 2023-07-20T15:09:22.035403+0000 mgr.y (mgr.24784) 25 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 6.8 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:24.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:24 smithi178 bash[104918]: cluster 2023-07-20T15:09:24.342015+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2023-07-20T15:09:24.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:24 smithi178 bash[104918]: cluster 2023-07-20T15:09:24.343968+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-20T15:09:24.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:24 smithi178 bash[104918]: cluster 2023-07-20T15:09:24.348019+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],b=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0],c=[v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0]} removed_ranks: {} 2023-07-20T15:09:24.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:24 smithi178 bash[104918]: cluster 2023-07-20T15:09:24.348646+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2023-07-20T15:09:24.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:24 smithi178 bash[104918]: cluster 2023-07-20T15:09:24.348692+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2023-07-20T15:09:24.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:24 smithi178 bash[104918]: cluster 2023-07-20T15:09:24.349666+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e24: y(active, since 34s), standbys: x 2023-07-20T15:09:24.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:24 smithi178 bash[104918]: cluster 2023-07-20T15:09:24.358124+0000 mon.a (mon.0) 7 : cluster [DBG] Standby manager daemon x restarted 2023-07-20T15:09:24.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:24 smithi178 bash[104918]: cluster 2023-07-20T15:09:24.358190+0000 mon.a (mon.0) 8 : cluster [DBG] Standby manager daemon x started 2023-07-20T15:09:24.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:24 smithi178 bash[104918]: cluster 2023-07-20T15:09:24.358447+0000 mon.a (mon.0) 9 : cluster [DBG] mgrmap e25: y(active, since 34s), standbys: x 2023-07-20T15:09:24.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:24 smithi178 bash[104918]: cluster 2023-07-20T15:09:24.359401+0000 mon.a (mon.0) 10 : cluster [INF] overall HEALTH_OK 2023-07-20T15:09:24.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:24 smithi178 bash[104918]: audit 2023-07-20T15:09:24.364982+0000 mon.a (mon.0) 11 : audit [INF] from='mgr.24784 ' entity='' 2023-07-20T15:09:25.422 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:24 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:24.976+0000 7f27284ca680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T15:09:25.452 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:25 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:25.016+0000 7fd6cadc1680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T15:09:26.070 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:25 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:25.724+0000 7f27284ca680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T15:09:26.071 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:25 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:25.809+0000 7f27284ca680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T15:09:26.169 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:25 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:25.815+0000 7fd6cadc1680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T15:09:26.169 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:25 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:25.898+0000 7fd6cadc1680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T15:09:26.407 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:26 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:26.021+0000 7f27284ca680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T15:09:26.452 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:26 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:25.361455+0000 mon.a (mon.0) 12 : cluster [DBG] mgrmap e26: y(active, since 35s), standbys: x 2023-07-20T15:09:26.453 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:26 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:26.119+0000 7fd6cadc1680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T15:09:26.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:26 smithi029 bash[108361]: cluster 2023-07-20T15:09:25.361455+0000 mon.a (mon.0) 12 : cluster [DBG] mgrmap e26: y(active, since 35s), standbys: x 2023-07-20T15:09:26.672 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:26 smithi178 bash[104918]: cluster 2023-07-20T15:09:25.361455+0000 mon.a (mon.0) 12 : cluster [DBG] mgrmap e26: y(active, since 35s), standbys: x 2023-07-20T15:09:27.321 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:26 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:26.971+0000 7f27284ca680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T15:09:27.321 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:27 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:27.101+0000 7f27284ca680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T15:09:27.321 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:27 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:27.181+0000 7f27284ca680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T15:09:27.452 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:27 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:27.115+0000 7fd6cadc1680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T15:09:27.452 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:27 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:27.251+0000 7fd6cadc1680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T15:09:27.452 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:27 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:27.334+0000 7fd6cadc1680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T15:09:27.672 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:27 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:27.272+0000 7f27284ca680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T15:09:27.673 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:27 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:27.469+0000 7f27284ca680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T15:09:27.952 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:27 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:27.429+0000 7fd6cadc1680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T15:09:27.952 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:27 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:27.633+0000 7fd6cadc1680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T15:09:28.172 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:27 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:27.752+0000 7f27284ca680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T15:09:28.173 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:27 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:27.852+0000 7f27284ca680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T15:09:28.452 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:27 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:27.929+0000 7fd6cadc1680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T15:09:28.452 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:28 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:28.033+0000 7fd6cadc1680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T15:09:28.922 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:28 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:28.585+0000 7f27284ca680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-20T15:09:28.923 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:28 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:28.669+0000 7f27284ca680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T15:09:28.923 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:28 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:28.760+0000 7f27284ca680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T15:09:29.202 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:28 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:28.801+0000 7fd6cadc1680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-20T15:09:29.202 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:28 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:28.888+0000 7fd6cadc1680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T15:09:29.203 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:28 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:28.985+0000 7fd6cadc1680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T15:09:29.249 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:28 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:28.939+0000 7f27284ca680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T15:09:29.492 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:29 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:29.171+0000 7fd6cadc1680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T15:09:29.521 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:29 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:29.200+0000 7f27284ca680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T15:09:29.521 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:29 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:29.336+0000 7f27284ca680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T15:09:29.775 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:29 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:29.443+0000 7fd6cadc1680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T15:09:29.776 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:29 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:29.584+0000 7fd6cadc1680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T15:09:29.780 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:29 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:29.472+0000 7f27284ca680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T15:09:29.781 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:29 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:29.646+0000 7f27284ca680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T15:09:30.053 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:29 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:29.726+0000 7fd6cadc1680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T15:09:30.053 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:29 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:29.913+0000 7fd6cadc1680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T15:09:30.054 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:29 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:29.734822+0000 mon.a (mon.0) 13 : cluster [DBG] Standby manager daemon x restarted 2023-07-20T15:09:30.054 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:29 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:29.734896+0000 mon.a (mon.0) 14 : cluster [DBG] Standby manager daemon x started 2023-07-20T15:09:30.054 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:29 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:29.735670+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.? 172.21.15.178:0/685122837' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2023-07-20T15:09:30.054 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:29 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:29.736417+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.? 172.21.15.178:0/685122837' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:09:30.054 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:29 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:29.737224+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.? 172.21.15.178:0/685122837' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2023-07-20T15:09:30.054 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:29 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:29.737466+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.? 172.21.15.178:0/685122837' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:09:30.055 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:29 smithi029 bash[108361]: cluster 2023-07-20T15:09:29.734822+0000 mon.a (mon.0) 13 : cluster [DBG] Standby manager daemon x restarted 2023-07-20T15:09:30.055 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:29 smithi029 bash[108361]: cluster 2023-07-20T15:09:29.734896+0000 mon.a (mon.0) 14 : cluster [DBG] Standby manager daemon x started 2023-07-20T15:09:30.055 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:29 smithi029 bash[108361]: audit 2023-07-20T15:09:29.735670+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.? 172.21.15.178:0/685122837' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2023-07-20T15:09:30.055 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:29 smithi029 bash[108361]: audit 2023-07-20T15:09:29.736417+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.? 172.21.15.178:0/685122837' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:09:30.055 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:29 smithi029 bash[108361]: audit 2023-07-20T15:09:29.737224+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.? 172.21.15.178:0/685122837' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2023-07-20T15:09:30.056 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:29 smithi029 bash[108361]: audit 2023-07-20T15:09:29.737466+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.? 172.21.15.178:0/685122837' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:09:30.173 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:09:29 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x[123475]: debug 2023-07-20T15:09:29.731+0000 7f27284ca680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T15:09:30.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:29 smithi178 bash[104918]: cluster 2023-07-20T15:09:29.734822+0000 mon.a (mon.0) 13 : cluster [DBG] Standby manager daemon x restarted 2023-07-20T15:09:30.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:29 smithi178 bash[104918]: cluster 2023-07-20T15:09:29.734896+0000 mon.a (mon.0) 14 : cluster [DBG] Standby manager daemon x started 2023-07-20T15:09:30.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:29 smithi178 bash[104918]: audit 2023-07-20T15:09:29.735670+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.? 172.21.15.178:0/685122837' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2023-07-20T15:09:30.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:29 smithi178 bash[104918]: audit 2023-07-20T15:09:29.736417+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.? 172.21.15.178:0/685122837' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:09:30.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:29 smithi178 bash[104918]: audit 2023-07-20T15:09:29.737224+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.? 172.21.15.178:0/685122837' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2023-07-20T15:09:30.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:29 smithi178 bash[104918]: audit 2023-07-20T15:09:29.737466+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.? 172.21.15.178:0/685122837' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:09:30.452 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:30 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:30.004+0000 7fd6cadc1680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T15:09:31.172 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:30 smithi178 bash[104918]: cluster 2023-07-20T15:09:29.789982+0000 mon.a (mon.0) 15 : cluster [DBG] mgrmap e27: y(active, since 40s), standbys: x 2023-07-20T15:09:31.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:30 smithi178 bash[104918]: cluster 2023-07-20T15:09:30.018951+0000 mon.a (mon.0) 16 : cluster [INF] Active manager daemon y restarted 2023-07-20T15:09:31.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:30 smithi178 bash[104918]: cluster 2023-07-20T15:09:30.019203+0000 mon.a (mon.0) 17 : cluster [INF] Activating manager daemon y 2023-07-20T15:09:31.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:30 smithi178 bash[104918]: cluster 2023-07-20T15:09:30.024682+0000 mon.a (mon.0) 18 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2023-07-20T15:09:31.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:30 smithi178 bash[104918]: cluster 2023-07-20T15:09:30.025062+0000 mon.a (mon.0) 19 : cluster [DBG] mgrmap e28: y(active, starting, since 0.00593247s), standbys: x 2023-07-20T15:09:31.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:30 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:29.789982+0000 mon.a (mon.0) 15 : cluster [DBG] mgrmap e27: y(active, since 40s), standbys: x 2023-07-20T15:09:31.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:30 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:30.018951+0000 mon.a (mon.0) 16 : cluster [INF] Active manager daemon y restarted 2023-07-20T15:09:31.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:30 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:30.019203+0000 mon.a (mon.0) 17 : cluster [INF] Activating manager daemon y 2023-07-20T15:09:31.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:30 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:30.024682+0000 mon.a (mon.0) 18 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2023-07-20T15:09:31.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:30 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:30.025062+0000 mon.a (mon.0) 19 : cluster [DBG] mgrmap e28: y(active, starting, since 0.00593247s), standbys: x 2023-07-20T15:09:31.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:30 smithi029 bash[108361]: cluster 2023-07-20T15:09:29.789982+0000 mon.a (mon.0) 15 : cluster [DBG] mgrmap e27: y(active, since 40s), standbys: x 2023-07-20T15:09:31.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:30 smithi029 bash[108361]: cluster 2023-07-20T15:09:30.018951+0000 mon.a (mon.0) 16 : cluster [INF] Active manager daemon y restarted 2023-07-20T15:09:31.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:30 smithi029 bash[108361]: cluster 2023-07-20T15:09:30.019203+0000 mon.a (mon.0) 17 : cluster [INF] Activating manager daemon y 2023-07-20T15:09:31.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:30 smithi029 bash[108361]: cluster 2023-07-20T15:09:30.024682+0000 mon.a (mon.0) 18 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2023-07-20T15:09:31.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:30 smithi029 bash[108361]: cluster 2023-07-20T15:09:30.025062+0000 mon.a (mon.0) 19 : cluster [DBG] mgrmap e28: y(active, starting, since 0.00593247s), standbys: x 2023-07-20T15:09:36.189 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENOTSUP: Warning: due to ceph-mgr restart, some PG states may not be up to date 2023-07-20T15:09:36.189 INFO:teuthology.orchestra.run.smithi029.stderr:Module 'orchestrator' is not enabled/loaded (required by command 'orch upgrade status'): use `ceph mgr module enable orchestrator` to enable it 2023-07-20T15:09:36.385 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.029653+0000 mon.c (mon.1) 150 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-20T15:09:36.385 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.029866+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-20T15:09:36.385 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.030096+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-20T15:09:36.385 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.043546+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-20T15:09:36.386 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.043875+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-20T15:09:36.386 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.044179+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:09:36.386 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.044589+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:09:36.386 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.044888+0000 mon.c (mon.1) 157 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:09:36.386 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.045202+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:09:36.386 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.045550+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:09:36.386 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.045903+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:09:36.387 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.046231+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:09:36.387 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.046637+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:09:36.387 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.046955+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-20T15:09:36.387 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.047195+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-20T15:09:36.387 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:36.134+0000 7fd67e5c7700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-07-20T15:09:36.388 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:36.135+0000 7fd67e5c7700 -1 mgr.server reply reply (95) Operation not supported Warning: due to ceph-mgr restart, some PG states may not be up to date 2023-07-20T15:09:36.388 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: Module 'orchestrator' is not enabled/loaded (required by command 'orch upgrade status'): use `ceph mgr module enable orchestrator` to enable it 2023-07-20T15:09:36.388 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: [79B blob data] 2023-07-20T15:09:36.388 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: [80B blob data] 2023-07-20T15:09:36.388 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.029653+0000 mon.c (mon.1) 150 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-20T15:09:36.389 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.029866+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-20T15:09:36.389 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.030096+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-20T15:09:36.389 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.043546+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-20T15:09:36.389 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.043875+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-20T15:09:36.389 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.044179+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:09:36.389 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.044589+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:09:36.390 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.044888+0000 mon.c (mon.1) 157 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:09:36.390 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.045202+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:09:36.390 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.045550+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:09:36.390 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.045903+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:09:36.390 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.046231+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:09:36.390 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.046637+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:09:36.390 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.046955+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-20T15:09:36.391 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.047195+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-20T15:09:36.391 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.047717+0000 mon.c (mon.1) 165 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-20T15:09:36.391 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.048551+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2023-07-20T15:09:36.391 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.049446+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2023-07-20T15:09:36.391 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.047717+0000 mon.c (mon.1) 165 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-20T15:09:36.391 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.048551+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2023-07-20T15:09:36.392 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.049446+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2023-07-20T15:09:36.392 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.049828+0000 mon.c (mon.1) 168 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2023-07-20T15:09:36.392 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.050212+0000 mon.c (mon.1) 169 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2023-07-20T15:09:36.392 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.050605+0000 mon.c (mon.1) 170 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi029"}]: dispatch 2023-07-20T15:09:36.392 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.051018+0000 mon.c (mon.1) 171 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi178"}]: dispatch 2023-07-20T15:09:36.392 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.051422+0000 mon.c (mon.1) 172 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2023-07-20T15:09:36.393 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.051789+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2023-07-20T15:09:36.393 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.052180+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2023-07-20T15:09:36.393 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.052597+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2023-07-20T15:09:36.393 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.052960+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2023-07-20T15:09:36.393 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.053355+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2023-07-20T15:09:36.393 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.053713+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2023-07-20T15:09:36.394 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.049828+0000 mon.c (mon.1) 168 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2023-07-20T15:09:36.394 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.050212+0000 mon.c (mon.1) 169 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2023-07-20T15:09:36.394 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.050605+0000 mon.c (mon.1) 170 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi029"}]: dispatch 2023-07-20T15:09:36.394 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.051018+0000 mon.c (mon.1) 171 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi178"}]: dispatch 2023-07-20T15:09:36.394 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.051422+0000 mon.c (mon.1) 172 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2023-07-20T15:09:36.395 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.051789+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2023-07-20T15:09:36.395 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.052180+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2023-07-20T15:09:36.395 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.052597+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2023-07-20T15:09:36.395 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.052960+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2023-07-20T15:09:36.396 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.053355+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2023-07-20T15:09:36.396 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.053713+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2023-07-20T15:09:36.396 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.054085+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2023-07-20T15:09:36.396 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.054430+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2023-07-20T15:09:36.396 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.054768+0000 mon.c (mon.1) 181 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2023-07-20T15:09:36.396 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.055111+0000 mon.c (mon.1) 182 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2023-07-20T15:09:36.396 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.055460+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2023-07-20T15:09:36.397 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.055802+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:09:36.397 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.056152+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:09:36.397 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.056517+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2023-07-20T15:09:36.397 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.056875+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2023-07-20T15:09:36.397 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.057265+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2023-07-20T15:09:36.397 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: audit 2023-07-20T15:09:36.057639+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2023-07-20T15:09:36.397 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:36 smithi029 bash[108361]: cluster 2023-07-20T15:09:36.073018+0000 mon.a (mon.0) 20 : cluster [INF] Manager daemon y is now available 2023-07-20T15:09:36.398 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.054085+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2023-07-20T15:09:36.398 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.054430+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2023-07-20T15:09:36.398 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.054768+0000 mon.c (mon.1) 181 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2023-07-20T15:09:36.398 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.055111+0000 mon.c (mon.1) 182 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2023-07-20T15:09:36.398 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.055460+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2023-07-20T15:09:36.398 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.055802+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:09:36.399 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.056152+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:09:36.399 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.056517+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2023-07-20T15:09:36.399 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.056875+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2023-07-20T15:09:36.399 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.057265+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2023-07-20T15:09:36.399 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.057639+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2023-07-20T15:09:36.399 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:36.073018+0000 mon.a (mon.0) 20 : cluster [INF] Manager daemon y is now available 2023-07-20T15:09:36.400 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.029653+0000 mon.c (mon.1) 150 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-20T15:09:36.400 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.029866+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-20T15:09:36.400 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.030096+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-20T15:09:36.400 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.043546+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-20T15:09:36.401 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.043875+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-20T15:09:36.401 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.044179+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:09:36.401 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.044589+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:09:36.401 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.044888+0000 mon.c (mon.1) 157 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-20T15:09:36.401 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.045202+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-20T15:09:36.401 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.045550+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-20T15:09:36.401 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.045903+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-20T15:09:36.402 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.046231+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-20T15:09:36.402 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.046637+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-20T15:09:36.402 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.046955+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-20T15:09:36.402 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.047195+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-20T15:09:36.402 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.047717+0000 mon.c (mon.1) 165 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-20T15:09:36.402 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.048551+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2023-07-20T15:09:36.402 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.049446+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2023-07-20T15:09:36.403 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.049828+0000 mon.c (mon.1) 168 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2023-07-20T15:09:36.403 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.050212+0000 mon.c (mon.1) 169 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2023-07-20T15:09:36.403 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.050605+0000 mon.c (mon.1) 170 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi029"}]: dispatch 2023-07-20T15:09:36.403 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.051018+0000 mon.c (mon.1) 171 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi178"}]: dispatch 2023-07-20T15:09:36.403 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.051422+0000 mon.c (mon.1) 172 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2023-07-20T15:09:36.403 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.051789+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2023-07-20T15:09:36.404 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.052180+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2023-07-20T15:09:36.404 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.052597+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2023-07-20T15:09:36.404 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.052960+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2023-07-20T15:09:36.404 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.053355+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2023-07-20T15:09:36.404 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.053713+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2023-07-20T15:09:36.404 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.054085+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2023-07-20T15:09:36.405 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.054430+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2023-07-20T15:09:36.405 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.054768+0000 mon.c (mon.1) 181 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2023-07-20T15:09:36.405 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.055111+0000 mon.c (mon.1) 182 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2023-07-20T15:09:36.405 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.055460+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2023-07-20T15:09:36.405 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.055802+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-20T15:09:36.406 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.056152+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-20T15:09:36.406 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.056517+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2023-07-20T15:09:36.406 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.056875+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2023-07-20T15:09:36.406 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.057265+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2023-07-20T15:09:36.406 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: audit 2023-07-20T15:09:36.057639+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2023-07-20T15:09:36.406 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:36 smithi178 bash[104918]: cluster 2023-07-20T15:09:36.073018+0000 mon.a (mon.0) 20 : cluster [INF] Manager daemon y is now available 2023-07-20T15:09:36.566 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'ceph orch ps' 2023-07-20T15:09:37.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:37 smithi178 bash[104918]: cluster 2023-07-20T15:09:36.129855+0000 mon.a (mon.0) 21 : cluster [DBG] mgrmap e29: y(active, since 6s), standbys: x 2023-07-20T15:09:37.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:37 smithi178 bash[104918]: audit 2023-07-20T15:09:36.136937+0000 mgr.y (mgr.34784) 1 : audit [DBG] from='client.44109 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:37.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:37 smithi178 bash[104918]: cluster 2023-07-20T15:09:36.140196+0000 mgr.y (mgr.34784) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:37.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:37 smithi178 bash[104918]: audit 2023-07-20T15:09:36.200686+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:37.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:37 smithi178 bash[104918]: audit 2023-07-20T15:09:36.203145+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:37.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:37 smithi178 bash[104918]: audit 2023-07-20T15:09:36.248711+0000 mon.c (mon.1) 192 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:09:37.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:37 smithi178 bash[104918]: audit 2023-07-20T15:09:36.249058+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.34784 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:09:37.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:37 smithi178 bash[104918]: audit 2023-07-20T15:09:36.255489+0000 mon.c (mon.1) 193 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2023-07-20T15:09:37.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:37 smithi178 bash[104918]: audit 2023-07-20T15:09:36.255832+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.34784 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2023-07-20T15:09:37.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:37 smithi178 bash[104918]: audit 2023-07-20T15:09:36.500472+0000 mon.c (mon.1) 194 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:09:37.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:37 smithi178 bash[104918]: audit 2023-07-20T15:09:36.501073+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:09:37.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:37 smithi029 bash[108361]: cluster 2023-07-20T15:09:36.129855+0000 mon.a (mon.0) 21 : cluster [DBG] mgrmap e29: y(active, since 6s), standbys: x 2023-07-20T15:09:37.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:37 smithi029 bash[108361]: audit 2023-07-20T15:09:36.136937+0000 mgr.y (mgr.34784) 1 : audit [DBG] from='client.44109 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:37.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:37 smithi029 bash[108361]: cluster 2023-07-20T15:09:36.140196+0000 mgr.y (mgr.34784) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:37.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:37 smithi029 bash[108361]: audit 2023-07-20T15:09:36.200686+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:37.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:37 smithi029 bash[108361]: audit 2023-07-20T15:09:36.203145+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:37.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:37 smithi029 bash[108361]: audit 2023-07-20T15:09:36.248711+0000 mon.c (mon.1) 192 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:09:37.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:37 smithi029 bash[108361]: audit 2023-07-20T15:09:36.249058+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.34784 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:09:37.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:37 smithi029 bash[108361]: audit 2023-07-20T15:09:36.255489+0000 mon.c (mon.1) 193 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2023-07-20T15:09:37.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:37 smithi029 bash[108361]: audit 2023-07-20T15:09:36.255832+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.34784 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2023-07-20T15:09:37.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:37 smithi029 bash[108361]: audit 2023-07-20T15:09:36.500472+0000 mon.c (mon.1) 194 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:09:37.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:37 smithi029 bash[108361]: audit 2023-07-20T15:09:36.501073+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:09:37.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:36.129855+0000 mon.a (mon.0) 21 : cluster [DBG] mgrmap e29: y(active, since 6s), standbys: x 2023-07-20T15:09:37.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.136937+0000 mgr.y (mgr.34784) 1 : audit [DBG] from='client.44109 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:37.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:36.140196+0000 mgr.y (mgr.34784) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:37.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.200686+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:37.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.203145+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:37.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.248711+0000 mon.c (mon.1) 192 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:09:37.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.249058+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.34784 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2023-07-20T15:09:37.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.255489+0000 mon.c (mon.1) 193 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2023-07-20T15:09:37.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.255832+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.34784 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2023-07-20T15:09:37.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.500472+0000 mon.c (mon.1) 194 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:09:37.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:36.501073+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:09:37.903 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-07-20T15:09:37.904 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.a smithi029 running (78s) 38s ago 5m 18.3M - 0.25.0 c8568f914cd2 27a8d3f42bb2 2023-07-20T15:09:37.904 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.a smithi178 running (5m) 20s ago 5m 31.8M - 6.6.2 87a51ecf0b1c 875ebfddec5b 2023-07-20T15:09:37.904 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.x smithi178 *:8443 running (24s) 20s ago 8m 42.7M - 16.2.13-355-ge2018073 247668761b27 12901326ede7 2023-07-20T15:09:37.904 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.y smithi029 *:8443 running (54s) 38s ago 9m 421M - 16.2.13-355-ge2018073 247668761b27 891723c152d4 2023-07-20T15:09:37.904 INFO:teuthology.orchestra.run.smithi029.stdout:mon.a smithi029 starting - - - 2048M 2023-07-20T15:09:37.905 INFO:teuthology.orchestra.run.smithi029.stdout:mon.b smithi178 running (8m) 20s ago 8m 216M 2048M 15.2.0 204a01f9b0b6 61793afb8d4c 2023-07-20T15:09:37.905 INFO:teuthology.orchestra.run.smithi029.stdout:mon.c smithi029 running (8m) 38s ago 8m 207M 2048M 15.2.0 204a01f9b0b6 b4038fa14c38 2023-07-20T15:09:37.905 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.a smithi029 running (5m) 38s ago 6m 13.0M - 1.6.1 458e026e6aa6 a2b5070c8a7f 2023-07-20T15:09:37.905 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.b smithi178 running (5m) 20s ago 6m 11.0M - 1.6.1 458e026e6aa6 ae43907cd0d8 2023-07-20T15:09:37.905 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (7m) 38s ago 7m 73.0M 4096M 15.2.0 204a01f9b0b6 a30d27a6dc87 2023-07-20T15:09:37.905 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (7m) 38s ago 7m 75.9M 4096M 15.2.0 204a01f9b0b6 81d19bc55e70 2023-07-20T15:09:37.905 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (7m) 38s ago 7m 61.3M 4096M 15.2.0 204a01f9b0b6 d60b18f8f253 2023-07-20T15:09:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi029 running (7m) 38s ago 7m 75.8M 4096M 15.2.0 204a01f9b0b6 0a92a9e1f2da 2023-07-20T15:09:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi178 running (6m) 20s ago 7m 80.3M 4096M 15.2.0 204a01f9b0b6 b133c6a0654f 2023-07-20T15:09:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi178 running (6m) 20s ago 6m 74.8M 4096M 15.2.0 204a01f9b0b6 405b4fc27850 2023-07-20T15:09:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:osd.6 smithi178 running (6m) 20s ago 6m 66.5M 4096M 15.2.0 204a01f9b0b6 4311ccd86c8b 2023-07-20T15:09:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:osd.7 smithi178 running (6m) 20s ago 6m 78.0M 4096M 15.2.0 204a01f9b0b6 b2a3cd19518d 2023-07-20T15:09:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.a smithi178 running (69s) 20s ago 6m 35.7M - 2.45.0 e1fbd49323c6 71bc04964ce1 2023-07-20T15:09:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:rgw.r.z.smithi029.fdztmk smithi029 running (5m) 38s ago 5m 53.8M - 15.2.0 204a01f9b0b6 45851ddbab0f 2023-07-20T15:09:37.907 INFO:teuthology.orchestra.run.smithi029.stdout:rgw.r.z.smithi178.bnfxtc smithi178 running (4m) 20s ago 4m 54.5M - 15.2.0 204a01f9b0b6 653ff44a4683 2023-07-20T15:09:38.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:38 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:37.844862+0000 mon.c (mon.1) 196 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:38.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:38 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:37.845340+0000 mon.c (mon.1) 197 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:38.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:38 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:37.845701+0000 mon.c (mon.1) 198 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:38 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:37.846044+0000 mon.c (mon.1) 199 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:38 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:37.846423+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:38 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:37.846793+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:38 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:37.848528+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:38.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:38 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:37.849203+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:38 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:37.849560+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:38 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:37.849861+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:38 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:37.850169+0000 mon.c (mon.1) 206 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:38 smithi029 bash[108361]: audit 2023-07-20T15:09:37.844862+0000 mon.c (mon.1) 196 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:38.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:38 smithi029 bash[108361]: audit 2023-07-20T15:09:37.845340+0000 mon.c (mon.1) 197 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:38.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:38 smithi029 bash[108361]: audit 2023-07-20T15:09:37.845701+0000 mon.c (mon.1) 198 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:38 smithi029 bash[108361]: audit 2023-07-20T15:09:37.846044+0000 mon.c (mon.1) 199 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:38 smithi029 bash[108361]: audit 2023-07-20T15:09:37.846423+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:38 smithi029 bash[108361]: audit 2023-07-20T15:09:37.846793+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:38 smithi029 bash[108361]: audit 2023-07-20T15:09:37.848528+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:38.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:38 smithi029 bash[108361]: audit 2023-07-20T15:09:37.849203+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:38 smithi029 bash[108361]: audit 2023-07-20T15:09:37.849560+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:38 smithi029 bash[108361]: audit 2023-07-20T15:09:37.849861+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:38 smithi029 bash[108361]: audit 2023-07-20T15:09:37.850169+0000 mon.c (mon.1) 206 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.305 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'ceph versions' 2023-07-20T15:09:38.571 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:38 smithi178 bash[104918]: audit 2023-07-20T15:09:37.844862+0000 mon.c (mon.1) 196 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:38.571 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:38 smithi178 bash[104918]: audit 2023-07-20T15:09:37.845340+0000 mon.c (mon.1) 197 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:38.571 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:38 smithi178 bash[104918]: audit 2023-07-20T15:09:37.845701+0000 mon.c (mon.1) 198 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.572 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:38 smithi178 bash[104918]: audit 2023-07-20T15:09:37.846044+0000 mon.c (mon.1) 199 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.572 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:38 smithi178 bash[104918]: audit 2023-07-20T15:09:37.846423+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.572 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:38 smithi178 bash[104918]: audit 2023-07-20T15:09:37.846793+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.572 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:38 smithi178 bash[104918]: audit 2023-07-20T15:09:37.848528+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2023-07-20T15:09:38.572 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:38 smithi178 bash[104918]: audit 2023-07-20T15:09:37.849203+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.572 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:38 smithi178 bash[104918]: audit 2023-07-20T15:09:37.849560+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.573 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:38 smithi178 bash[104918]: audit 2023-07-20T15:09:37.849861+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:38.573 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:38 smithi178 bash[104918]: audit 2023-07-20T15:09:37.850169+0000 mon.c (mon.1) 206 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:39.371 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:39 smithi029 bash[108361]: audit 2023-07-20T15:09:37.842699+0000 mgr.y (mgr.34784) 3 : audit [DBG] from='client.44127 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:39.372 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:39 smithi029 bash[108361]: cluster 2023-07-20T15:09:38.045668+0000 mgr.y (mgr.34784) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:39.372 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:39 smithi029 bash[108361]: cluster 2023-07-20T15:09:38.141983+0000 mon.a (mon.0) 24 : cluster [DBG] mgrmap e30: y(active, since 8s), standbys: x 2023-07-20T15:09:39.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:39 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:37.842699+0000 mgr.y (mgr.34784) 3 : audit [DBG] from='client.44127 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:39.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:39 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:38.045668+0000 mgr.y (mgr.34784) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:39.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:39 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:38.141983+0000 mon.a (mon.0) 24 : cluster [DBG] mgrmap e30: y(active, since 8s), standbys: x 2023-07-20T15:09:39.595 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:39 smithi178 bash[104918]: audit 2023-07-20T15:09:37.842699+0000 mgr.y (mgr.34784) 3 : audit [DBG] from='client.44127 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:09:39.595 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:39 smithi178 bash[104918]: cluster 2023-07-20T15:09:38.045668+0000 mgr.y (mgr.34784) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:39.596 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:39 smithi178 bash[104918]: cluster 2023-07-20T15:09:38.141983+0000 mon.a (mon.0) 24 : cluster [DBG] mgrmap e30: y(active, since 8s), standbys: x 2023-07-20T15:09:39.826 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-07-20T15:09:39.827 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-07-20T15:09:39.827 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2023-07-20T15:09:39.827 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)": 1 2023-07-20T15:09:39.827 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:09:39.827 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-07-20T15:09:39.827 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)": 2 2023-07-20T15:09:39.828 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:09:39.828 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-07-20T15:09:39.828 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2023-07-20T15:09:39.828 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:09:39.828 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": {}, 2023-07-20T15:09:39.828 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw": { 2023-07-20T15:09:39.828 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2023-07-20T15:09:39.829 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:09:39.829 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-07-20T15:09:39.829 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 12, 2023-07-20T15:09:39.829 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)": 3 2023-07-20T15:09:39.829 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-07-20T15:09:39.829 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-07-20T15:09:40.256 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2023-07-20T15:09:40.398 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:40 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:39.778258+0000 mon.c (mon.1) 207 : audit [DBG] from='client.? 172.21.15.29:0/513338072' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:09:40.399 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:40 smithi029 bash[108361]: audit 2023-07-20T15:09:39.778258+0000 mon.c (mon.1) 207 : audit [DBG] from='client.? 172.21.15.29:0/513338072' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:09:40.399 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:40 smithi029 bash[108361]: audit 2023-07-20T15:09:39.945296+0000 mon.c (mon.1) 208 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222402969, \"cpu_percentage\": \"1.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943261Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"12901326ede7\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 407581491, \"cpu_percentage\": \"54.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:39.943413Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:09:13.718116Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 86192947, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943490Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80142663, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943555Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 71995228, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943618Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83676364, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943680Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 39887831, \"cpu_percentage\": \"0.72%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943744Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 11062476, \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943807Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33145487, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943868Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57535365, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943928Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:39.944051Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:40.399 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:40 smithi029 bash[108361]: audit 2023-07-20T15:09:39.949226+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:40.400 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:40 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:39.945296+0000 mon.c (mon.1) 208 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222402969, \"cpu_percentage\": \"1.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943261Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"12901326ede7\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 407581491, \"cpu_percentage\": \"54.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:39.943413Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:09:13.718116Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 86192947, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943490Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80142663, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943555Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 71995228, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943618Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83676364, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943680Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 39887831, \"cpu_percentage\": \"0.72%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943744Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 11062476, \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943807Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33145487, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943868Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57535365, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943928Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:39.944051Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:40.400 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:40 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:39.949226+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:40.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:40 smithi178 bash[104918]: audit 2023-07-20T15:09:39.778258+0000 mon.c (mon.1) 207 : audit [DBG] from='client.? 172.21.15.29:0/513338072' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:09:40.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:40 smithi178 bash[104918]: audit 2023-07-20T15:09:39.945296+0000 mon.c (mon.1) 208 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi178","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi178\", \"container_id\": \"61793afb8d4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222402969, \"cpu_percentage\": \"1.20%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943261Z\", \"created\": \"2023-07-20T15:01:08.385489Z\", \"started\": \"2023-07-20T15:01:08.420332Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi178\", \"container_id\": \"12901326ede7\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 407581491, \"cpu_percentage\": \"54.32%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:39.943413Z\", \"created\": \"2023-07-20T15:01:25.257195Z\", \"started\": \"2023-07-20T15:09:13.718116Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi178\", \"container_id\": \"b133c6a0654f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 86192947, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943490Z\", \"created\": \"2023-07-20T15:02:32.970008Z\", \"started\": \"2023-07-20T15:02:47.527451Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi178\", \"container_id\": \"405b4fc27850\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 80142663, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943555Z\", \"created\": \"2023-07-20T15:02:48.109741Z\", \"started\": \"2023-07-20T15:03:02.382473Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi178\", \"container_id\": \"4311ccd86c8b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 71995228, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943618Z\", \"created\": \"2023-07-20T15:03:02.897482Z\", \"started\": \"2023-07-20T15:03:17.652291Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi178\", \"container_id\": \"b2a3cd19518d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 83676364, \"cpu_percentage\": \"0.64%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943680Z\", \"created\": \"2023-07-20T15:03:18.281216Z\", \"started\": \"2023-07-20T15:03:19.204799Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi178\", \"container_id\": \"71bc04964ce1\", \"container_image_id\": \"e1fbd49323c628ccc8c11aea113eddc294c4bd1887dc627d175331c325df10fd\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:9309deb7c981e8a94584d9ed689fd62f7ac4549d816fd3881550311cf056a237\", \"docker.io/prom/prometheus@sha256:377894421d88619dc51dbcd46ceba75a5ea842b0a878f173e6476f20c1645630\"], \"memory_usage\": 39887831, \"cpu_percentage\": \"0.72%\", \"version\": \"2.45.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943744Z\", \"created\": \"2023-07-20T15:03:34.602933Z\", \"started\": \"2023-07-20T15:08:28.645510Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi178\", \"container_id\": \"ae43907cd0d8\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"memory_usage\": 11062476, \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943807Z\", \"created\": \"2023-07-20T15:03:37.229888Z\", \"started\": \"2023-07-20T15:03:39.375117Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi178\", \"container_id\": \"875ebfddec5b\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 33145487, \"cpu_percentage\": \"0.50%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943868Z\", \"created\": \"2023-07-20T15:03:52.727620Z\", \"started\": \"2023-07-20T15:03:52.834752Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi178.bnfxtc\", \"daemon_name\": \"rgw.r.z.smithi178.bnfxtc\", \"hostname\": \"smithi178\", \"container_id\": \"653ff44a4683\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 57535365, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:39.943928Z\", \"created\": \"2023-07-20T15:04:38.791823Z\", \"started\": \"2023-07-20T15:04:38.827724Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922403Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3b90f378-fbc0-4d3c-bb1e-ac0d5249cb6b\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"BCvHyY-WNfZ-s3RO-XnQa-d99r-LwRY-oq91E2\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7a34c575-fbe7-465c-9f28-cdd42b784e43\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"bxWUj2-zhV9-WmJy-79R0-NIyz-fARc-N0C1yR\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7ff93523-43ae-478c-a87c-1044653beb64\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"XSOG0H-BQQb-UbLS-20SO-A9wb-ijWF-lN0gFT\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e424090f-0486-4402-887d-f4fc310d93d6\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"6aHc7j-c9XX-UiX0-a8Ze-LFJ7-EbGl-2rWmM1\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB75130029480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.922411Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XFJ4\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:19.277966Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:01.375398Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:44.084364Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:58.923500Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:14.287638Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:16.518808Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2023-07-20T15:08:20.172573Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.760129Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2023-07-20T15:03:43.263789Z\"}, \"rgw.r.z.smithi178.bnfxtc\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:37.575893Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:39.944051Z\", \"last_device_update\": \"2023-07-20T15:03:22.112801Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:49.770688Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:40.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:40 smithi178 bash[104918]: audit 2023-07-20T15:09:39.949226+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:41.314 INFO:teuthology.orchestra.run.smithi029.stdout:wait for servicemap items w/ changing names to refresh 2023-07-20T15:09:41.429 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:41 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:40.046042+0000 mgr.y (mgr.34784) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:41.430 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:41 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:40.233911+0000 mon.c (mon.1) 209 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:41.430 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:41 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:40.234435+0000 mon.c (mon.1) 210 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:41.430 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:41 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:40.234837+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:41.430 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:41 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:40.235223+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:41.431 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:41 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:40.235619+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:41.431 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:41 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:40.235988+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:41.431 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:41 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:40.236366+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:41.431 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:41 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:40.236713+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:41.431 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:41 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:40.237125+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:41.431 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:41 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:40.882464+0000 mon.c (mon.1) 218 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"0c199917352e\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"cpu_percentage\": \"2.08%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2023-07-20T15:09:40.880506Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T15:09:21.087946Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"cpu_percentage\": \"27.01%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:40.880648Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880723Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880790Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880856Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880920Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880984Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.881046Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"cpu_percentage\": \"0.30%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.881109Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.881171Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:18.789697Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:40.881290Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:41.432 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:41 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:40.887568+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:41.432 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:41 smithi029 bash[108361]: cluster 2023-07-20T15:09:40.046042+0000 mgr.y (mgr.34784) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:41.432 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:41 smithi029 bash[108361]: audit 2023-07-20T15:09:40.233911+0000 mon.c (mon.1) 209 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:41.432 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:41 smithi029 bash[108361]: audit 2023-07-20T15:09:40.234435+0000 mon.c (mon.1) 210 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:41.432 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:41 smithi029 bash[108361]: audit 2023-07-20T15:09:40.234837+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:41.433 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:41 smithi029 bash[108361]: audit 2023-07-20T15:09:40.235223+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:41.433 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:41 smithi029 bash[108361]: audit 2023-07-20T15:09:40.235619+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:41.433 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:41 smithi029 bash[108361]: audit 2023-07-20T15:09:40.235988+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:41.433 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:41 smithi029 bash[108361]: audit 2023-07-20T15:09:40.236366+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:41.433 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:41 smithi029 bash[108361]: audit 2023-07-20T15:09:40.236713+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:41.433 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:41 smithi029 bash[108361]: audit 2023-07-20T15:09:40.237125+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:41.434 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:41 smithi029 bash[108361]: audit 2023-07-20T15:09:40.882464+0000 mon.c (mon.1) 218 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"0c199917352e\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"cpu_percentage\": \"2.08%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2023-07-20T15:09:40.880506Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T15:09:21.087946Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"cpu_percentage\": \"27.01%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:40.880648Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880723Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880790Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880856Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880920Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880984Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.881046Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"cpu_percentage\": \"0.30%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.881109Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.881171Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:18.789697Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:40.881290Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:41.434 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:41 smithi029 bash[108361]: audit 2023-07-20T15:09:40.887568+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:41.654 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'sleep 60' 2023-07-20T15:09:41.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:41 smithi178 bash[104918]: cluster 2023-07-20T15:09:40.046042+0000 mgr.y (mgr.34784) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:41.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:41 smithi178 bash[104918]: audit 2023-07-20T15:09:40.233911+0000 mon.c (mon.1) 209 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:41.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:41 smithi178 bash[104918]: audit 2023-07-20T15:09:40.234435+0000 mon.c (mon.1) 210 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:41.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:41 smithi178 bash[104918]: audit 2023-07-20T15:09:40.234837+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:41.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:41 smithi178 bash[104918]: audit 2023-07-20T15:09:40.235223+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:41.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:41 smithi178 bash[104918]: audit 2023-07-20T15:09:40.235619+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:41.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:41 smithi178 bash[104918]: audit 2023-07-20T15:09:40.235988+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:41.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:41 smithi178 bash[104918]: audit 2023-07-20T15:09:40.236366+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:41.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:41 smithi178 bash[104918]: audit 2023-07-20T15:09:40.236713+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:41.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:41 smithi178 bash[104918]: audit 2023-07-20T15:09:40.237125+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:41.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:41 smithi178 bash[104918]: audit 2023-07-20T15:09:40.882464+0000 mon.c (mon.1) 218 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"0c199917352e\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"cpu_percentage\": \"2.08%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2023-07-20T15:09:40.880506Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T15:09:21.087946Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"cpu_percentage\": \"27.01%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:40.880648Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"b4038fa14c38\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880723Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:00:58.462188Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880790Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880856Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880920Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880984Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.881046Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"cpu_percentage\": \"0.30%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.881109Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.881171Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:08.356320Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:18.789697Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:40.881290Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:41.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:41 smithi178 bash[104918]: audit 2023-07-20T15:09:40.887568+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:42.195 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:42 smithi029 bash[108361]: audit 2023-07-20T15:09:41.200834+0000 mon.c (mon.1) 219 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:42.195 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:42 smithi029 bash[108361]: audit 2023-07-20T15:09:41.201231+0000 mon.c (mon.1) 220 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:42.196 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:42 smithi029 bash[108361]: audit 2023-07-20T15:09:41.201564+0000 mon.c (mon.1) 221 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:42.196 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:42 smithi029 bash[108361]: audit 2023-07-20T15:09:41.201877+0000 mon.c (mon.1) 222 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:42.196 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:42 smithi029 bash[108361]: audit 2023-07-20T15:09:41.202199+0000 mon.c (mon.1) 223 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:42.196 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:42 smithi029 bash[108361]: audit 2023-07-20T15:09:41.202551+0000 mon.c (mon.1) 224 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:42.196 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:42 smithi029 bash[108361]: audit 2023-07-20T15:09:41.202883+0000 mon.c (mon.1) 225 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:42.196 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:42 smithi029 bash[108361]: audit 2023-07-20T15:09:41.203203+0000 mon.c (mon.1) 226 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:42.197 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:42 smithi029 bash[108361]: audit 2023-07-20T15:09:41.203549+0000 mon.c (mon.1) 227 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:42.197 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:42 smithi029 bash[108361]: audit 2023-07-20T15:09:41.204976+0000 mon.c (mon.1) 228 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:42.197 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:42 smithi029 bash[108361]: audit 2023-07-20T15:09:41.208802+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:42.197 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:42 smithi029 bash[108361]: audit 2023-07-20T15:09:41.214669+0000 mon.c (mon.1) 229 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:42.197 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:42 smithi029 bash[108361]: audit 2023-07-20T15:09:41.215544+0000 mon.c (mon.1) 230 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:42.197 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:42 smithi029 bash[108361]: audit 2023-07-20T15:09:41.217070+0000 mon.c (mon.1) 231 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:09:42.197 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:42 smithi029 bash[108361]: audit 2023-07-20T15:09:41.218031+0000 mon.c (mon.1) 232 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-07-20T15:09:42.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:42 smithi029 bash[108361]: audit 2023-07-20T15:09:41.218638+0000 mon.c (mon.1) 233 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2023-07-20T15:09:42.198 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:42 smithi029 bash[108361]: cephadm 2023-07-20T15:09:41.219084+0000 mgr.y (mgr.34784) 6 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2023-07-20T15:09:42.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:41.200834+0000 mon.c (mon.1) 219 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:42.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:41.201231+0000 mon.c (mon.1) 220 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:42.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:41.201564+0000 mon.c (mon.1) 221 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:42.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:41.201877+0000 mon.c (mon.1) 222 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:42.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:41.202199+0000 mon.c (mon.1) 223 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:42.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:41.202551+0000 mon.c (mon.1) 224 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:42.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:41.202883+0000 mon.c (mon.1) 225 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:42.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:41.203203+0000 mon.c (mon.1) 226 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:42.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:41.203549+0000 mon.c (mon.1) 227 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:42.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:41.204976+0000 mon.c (mon.1) 228 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:42.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:41.208802+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:42.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:41.214669+0000 mon.c (mon.1) 229 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:42.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:41.215544+0000 mon.c (mon.1) 230 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:42.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:41.217070+0000 mon.c (mon.1) 231 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:09:42.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:41.218031+0000 mon.c (mon.1) 232 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-07-20T15:09:42.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:41.218638+0000 mon.c (mon.1) 233 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2023-07-20T15:09:42.200 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:09:41.219084+0000 mgr.y (mgr.34784) 6 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2023-07-20T15:09:42.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:42 smithi178 bash[104918]: audit 2023-07-20T15:09:41.200834+0000 mon.c (mon.1) 219 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:42.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:42 smithi178 bash[104918]: audit 2023-07-20T15:09:41.201231+0000 mon.c (mon.1) 220 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:42.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:42 smithi178 bash[104918]: audit 2023-07-20T15:09:41.201564+0000 mon.c (mon.1) 221 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:42.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:42 smithi178 bash[104918]: audit 2023-07-20T15:09:41.201877+0000 mon.c (mon.1) 222 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:42.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:42 smithi178 bash[104918]: audit 2023-07-20T15:09:41.202199+0000 mon.c (mon.1) 223 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:42.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:42 smithi178 bash[104918]: audit 2023-07-20T15:09:41.202551+0000 mon.c (mon.1) 224 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:42.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:42 smithi178 bash[104918]: audit 2023-07-20T15:09:41.202883+0000 mon.c (mon.1) 225 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:42.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:42 smithi178 bash[104918]: audit 2023-07-20T15:09:41.203203+0000 mon.c (mon.1) 226 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:09:42.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:42 smithi178 bash[104918]: audit 2023-07-20T15:09:41.203549+0000 mon.c (mon.1) 227 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2023-07-20T15:09:42.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:42 smithi178 bash[104918]: audit 2023-07-20T15:09:41.204976+0000 mon.c (mon.1) 228 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:42.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:42 smithi178 bash[104918]: audit 2023-07-20T15:09:41.208802+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:42.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:42 smithi178 bash[104918]: audit 2023-07-20T15:09:41.214669+0000 mon.c (mon.1) 229 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:42.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:42 smithi178 bash[104918]: audit 2023-07-20T15:09:41.215544+0000 mon.c (mon.1) 230 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:42.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:42 smithi178 bash[104918]: audit 2023-07-20T15:09:41.217070+0000 mon.c (mon.1) 231 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:09:42.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:42 smithi178 bash[104918]: audit 2023-07-20T15:09:41.218031+0000 mon.c (mon.1) 232 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-07-20T15:09:42.676 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:42 smithi178 bash[104918]: audit 2023-07-20T15:09:41.218638+0000 mon.c (mon.1) 233 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2023-07-20T15:09:42.676 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:42 smithi178 bash[104918]: cephadm 2023-07-20T15:09:41.219084+0000 mgr.y (mgr.34784) 6 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2023-07-20T15:09:43.397 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:43 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:42.046936+0000 mgr.y (mgr.34784) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:43.398 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:43 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:09:42.255059+0000 mgr.y (mgr.34784) 8 : cephadm [INF] Upgrade: Updating mon.c 2023-07-20T15:09:43.398 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:43 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:42.255436+0000 mon.c (mon.1) 234 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.c"}]: dispatch 2023-07-20T15:09:43.398 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:43 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:42.259361+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:43.398 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:43 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:42.260810+0000 mon.c (mon.1) 235 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:43.398 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:43 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:42.261419+0000 mon.c (mon.1) 236 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:43.399 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:43 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:42.261984+0000 mon.c (mon.1) 237 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:43.399 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:43 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:09:42.262566+0000 mgr.y (mgr.34784) 9 : cephadm [INF] Deploying daemon mon.c on smithi029 2023-07-20T15:09:43.399 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:43 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:42.262953+0000 mon.c (mon.1) 238 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2023-07-20T15:09:43.399 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:43 smithi029 bash[108361]: cluster 2023-07-20T15:09:42.046936+0000 mgr.y (mgr.34784) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:43.399 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:43 smithi029 bash[108361]: cephadm 2023-07-20T15:09:42.255059+0000 mgr.y (mgr.34784) 8 : cephadm [INF] Upgrade: Updating mon.c 2023-07-20T15:09:43.399 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:43 smithi029 bash[108361]: audit 2023-07-20T15:09:42.255436+0000 mon.c (mon.1) 234 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.c"}]: dispatch 2023-07-20T15:09:43.400 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:43 smithi029 bash[108361]: audit 2023-07-20T15:09:42.259361+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:43.400 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:43 smithi029 bash[108361]: audit 2023-07-20T15:09:42.260810+0000 mon.c (mon.1) 235 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:43.400 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:43 smithi029 bash[108361]: audit 2023-07-20T15:09:42.261419+0000 mon.c (mon.1) 236 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:43.400 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:43 smithi029 bash[108361]: audit 2023-07-20T15:09:42.261984+0000 mon.c (mon.1) 237 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:43.400 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:43 smithi029 bash[108361]: cephadm 2023-07-20T15:09:42.262566+0000 mgr.y (mgr.34784) 9 : cephadm [INF] Deploying daemon mon.c on smithi029 2023-07-20T15:09:43.400 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:43 smithi029 bash[108361]: audit 2023-07-20T15:09:42.262953+0000 mon.c (mon.1) 238 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2023-07-20T15:09:43.401 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:43 smithi029 systemd[1]: Stopping Ceph mon.c for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:09:43.401 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:43 smithi029 bash[108361]: debug 2023-07-20T15:09:43.349+0000 7fe83879e700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T15:09:43.401 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:43 smithi029 bash[108361]: debug 2023-07-20T15:09:43.349+0000 7fe83879e700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-07-20T15:09:43.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:43 smithi178 bash[104918]: cluster 2023-07-20T15:09:42.046936+0000 mgr.y (mgr.34784) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:43.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:43 smithi178 bash[104918]: cephadm 2023-07-20T15:09:42.255059+0000 mgr.y (mgr.34784) 8 : cephadm [INF] Upgrade: Updating mon.c 2023-07-20T15:09:43.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:43 smithi178 bash[104918]: audit 2023-07-20T15:09:42.255436+0000 mon.c (mon.1) 234 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.c"}]: dispatch 2023-07-20T15:09:43.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:43 smithi178 bash[104918]: audit 2023-07-20T15:09:42.259361+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:43.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:43 smithi178 bash[104918]: audit 2023-07-20T15:09:42.260810+0000 mon.c (mon.1) 235 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:43.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:43 smithi178 bash[104918]: audit 2023-07-20T15:09:42.261419+0000 mon.c (mon.1) 236 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:43.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:43 smithi178 bash[104918]: audit 2023-07-20T15:09:42.261984+0000 mon.c (mon.1) 237 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:43.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:43 smithi178 bash[104918]: cephadm 2023-07-20T15:09:42.262566+0000 mgr.y (mgr.34784) 9 : cephadm [INF] Deploying daemon mon.c on smithi029 2023-07-20T15:09:43.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:43 smithi178 bash[104918]: audit 2023-07-20T15:09:42.262953+0000 mon.c (mon.1) 238 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2023-07-20T15:09:44.130 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:43 smithi029 bash[133892]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon.c 2023-07-20T15:09:44.702 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.c.service: Succeeded. 2023-07-20T15:09:44.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 systemd[1]: Stopped Ceph mon.c for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:09:44.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 systemd[1]: Starting Ceph mon.c for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:09:45.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.786+0000 7f57d50fa880 0 set uid:gid to 167:167 (ceph:ceph) 2023-07-20T15:09:45.203 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.786+0000 7f57d50fa880 0 ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable), process ceph-mon, pid 7 2023-07-20T15:09:45.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.786+0000 7f57d50fa880 0 pidfile_write: ignore empty --pid-file 2023-07-20T15:09:45.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 bash[134071]: 35b78756c75868f7fed342c5ac5a007907c3c68664e593a7df9ca18f405f4fc2 2023-07-20T15:09:45.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 0 load: jerasure load: lrc load: isa 2023-07-20T15:09:45.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: RocksDB version: 6.8.1 2023-07-20T15:09:45.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.204 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-07-20T15:09:45.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Compile date Jul 18 2023 2023-07-20T15:09:45.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: DB SUMMARY 2023-07-20T15:09:45.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: CURRENT file: CURRENT 2023-07-20T15:09:45.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: IDENTITY file: IDENTITY 2023-07-20T15:09:45.205 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 835 Bytes 2023-07-20T15:09:45.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 2, files: 000024.sst 000025.sst 2023-07-20T15:09:45.206 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000022.log size: 383616 ; 2023-07-20T15:09:45.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.error_if_exists: 0 2023-07-20T15:09:45.207 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.create_if_missing: 0 2023-07-20T15:09:45.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.paranoid_checks: 1 2023-07-20T15:09:45.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.env: 0x5604aad75080 2023-07-20T15:09:45.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.fs: Posix File System 2023-07-20T15:09:45.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.info_log: 0x5604abd61960 2023-07-20T15:09:45.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.max_file_opening_threads: 16 2023-07-20T15:09:45.208 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.statistics: (nil) 2023-07-20T15:09:45.209 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.use_fsync: 0 2023-07-20T15:09:45.209 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.max_log_file_size: 0 2023-07-20T15:09:45.209 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-20T15:09:45.209 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.log_file_time_to_roll: 0 2023-07-20T15:09:45.209 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.keep_log_file_num: 1000 2023-07-20T15:09:45.209 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.recycle_log_file_num: 0 2023-07-20T15:09:45.209 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.allow_fallocate: 1 2023-07-20T15:09:45.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.allow_mmap_reads: 0 2023-07-20T15:09:45.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.allow_mmap_writes: 0 2023-07-20T15:09:45.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.use_direct_reads: 0 2023-07-20T15:09:45.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-20T15:09:45.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.create_missing_column_families: 0 2023-07-20T15:09:45.210 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.db_log_dir: 2023-07-20T15:09:45.211 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2023-07-20T15:09:45.211 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.table_cache_numshardbits: 6 2023-07-20T15:09:45.211 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.max_subcompactions: 1 2023-07-20T15:09:45.211 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.max_background_flushes: -1 2023-07-20T15:09:45.211 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-07-20T15:09:45.211 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-07-20T15:09:45.212 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-07-20T15:09:45.212 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-20T15:09:45.212 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-07-20T15:09:45.212 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.advise_random_on_open: 1 2023-07-20T15:09:45.212 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.db_write_buffer_size: 0 2023-07-20T15:09:45.212 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.write_buffer_manager: 0x5604aca5c1b0 2023-07-20T15:09:45.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-20T15:09:45.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-07-20T15:09:45.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-20T15:09:45.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.use_adaptive_mutex: 0 2023-07-20T15:09:45.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.rate_limiter: (nil) 2023-07-20T15:09:45.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-20T15:09:45.213 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.wal_recovery_mode: 2 2023-07-20T15:09:45.214 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.enable_thread_tracking: 0 2023-07-20T15:09:45.214 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.enable_pipelined_write: 0 2023-07-20T15:09:45.214 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.unordered_write: 0 2023-07-20T15:09:45.214 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-20T15:09:45.214 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-20T15:09:45.214 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-20T15:09:45.216 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-20T15:09:45.216 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.row_cache: None 2023-07-20T15:09:45.216 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.wal_filter: None 2023-07-20T15:09:45.217 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-20T15:09:45.217 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.allow_ingest_behind: 0 2023-07-20T15:09:45.217 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.preserve_deletes: 0 2023-07-20T15:09:45.217 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.two_write_queues: 0 2023-07-20T15:09:45.217 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.manual_wal_flush: 0 2023-07-20T15:09:45.217 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.atomic_flush: 0 2023-07-20T15:09:45.218 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-20T15:09:45.218 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.persist_stats_to_disk: 0 2023-07-20T15:09:45.218 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-07-20T15:09:45.218 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.log_readahead_size: 0 2023-07-20T15:09:45.218 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2023-07-20T15:09:45.218 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.max_background_jobs: 2 2023-07-20T15:09:45.218 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.max_background_compactions: -1 2023-07-20T15:09:45.219 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-20T15:09:45.219 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-20T15:09:45.219 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.delayed_write_rate : 16777216 2023-07-20T15:09:45.219 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.max_total_wal_size: 0 2023-07-20T15:09:45.219 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-20T15:09:45.219 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.stats_dump_period_sec: 600 2023-07-20T15:09:45.219 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.stats_persist_period_sec: 600 2023-07-20T15:09:45.220 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-20T15:09:45.220 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.max_open_files: -1 2023-07-20T15:09:45.220 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.bytes_per_sync: 0 2023-07-20T15:09:45.220 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-07-20T15:09:45.220 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-07-20T15:09:45.220 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Options.compaction_readahead_size: 0 2023-07-20T15:09:45.220 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Compression algorithms supported: 2023-07-20T15:09:45.221 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-20T15:09:45.221 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: kZSTD supported: 0 2023-07-20T15:09:45.221 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: kXpressCompression supported: 0 2023-07-20T15:09:45.221 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: kLZ4HCCompression supported: 1 2023-07-20T15:09:45.221 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: kLZ4Compression supported: 1 2023-07-20T15:09:45.221 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: kBZip2Compression supported: 0 2023-07-20T15:09:45.222 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: kZlibCompression supported: 1 2023-07-20T15:09:45.222 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: kSnappyCompression supported: 1 2023-07-20T15:09:45.222 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-07-20T15:09:45.222 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.791+0000 7f57d50fa880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-07-20T15:09:45.222 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.222 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2023-07-20T15:09:45.223 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.223 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-20T15:09:45.223 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.merge_operator: 2023-07-20T15:09:45.223 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compaction_filter: None 2023-07-20T15:09:45.223 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compaction_filter_factory: None 2023-07-20T15:09:45.223 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-07-20T15:09:45.223 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.table_factory: BlockBasedTable 2023-07-20T15:09:45.224 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5604abd11d18) 2023-07-20T15:09:45.224 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cache_index_and_filter_blocks: 1 2023-07-20T15:09:45.224 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cache_index_and_filter_blocks_with_high_priority: 0 2023-07-20T15:09:45.224 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-20T15:09:45.224 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: pin_top_level_index_and_filter: 1 2023-07-20T15:09:45.224 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: index_type: 0 2023-07-20T15:09:45.225 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: data_block_index_type: 0 2023-07-20T15:09:45.225 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: index_shortening: 1 2023-07-20T15:09:45.225 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: data_block_hash_table_util_ratio: 0.750000 2023-07-20T15:09:45.225 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: hash_index_allow_collision: 1 2023-07-20T15:09:45.225 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: checksum: 1 2023-07-20T15:09:45.225 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: no_block_cache: 0 2023-07-20T15:09:45.225 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: block_cache: 0x5604abd46f10 2023-07-20T15:09:45.225 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: block_cache_name: BinnedLRUCache 2023-07-20T15:09:45.226 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: block_cache_options: 2023-07-20T15:09:45.226 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: capacity : 536870912 2023-07-20T15:09:45.226 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: num_shard_bits : 4 2023-07-20T15:09:45.226 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: strict_capacity_limit : 0 2023-07-20T15:09:45.226 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: high_pri_pool_ratio: 0.000 2023-07-20T15:09:45.227 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: block_cache_compressed: (nil) 2023-07-20T15:09:45.227 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: persistent_cache: (nil) 2023-07-20T15:09:45.227 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: block_size: 4096 2023-07-20T15:09:45.227 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: block_size_deviation: 10 2023-07-20T15:09:45.227 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: block_restart_interval: 16 2023-07-20T15:09:45.227 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: index_block_restart_interval: 1 2023-07-20T15:09:45.227 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: metadata_block_size: 4096 2023-07-20T15:09:45.228 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: partition_filters: 0 2023-07-20T15:09:45.228 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: use_delta_encoding: 1 2023-07-20T15:09:45.228 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: filter_policy: rocksdb.BuiltinBloomFilter 2023-07-20T15:09:45.228 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: whole_key_filtering: 1 2023-07-20T15:09:45.228 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: verify_compression: 0 2023-07-20T15:09:45.228 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: read_amp_bytes_per_bit: 0 2023-07-20T15:09:45.229 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: format_version: 2 2023-07-20T15:09:45.229 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: enable_index_compression: 1 2023-07-20T15:09:45.229 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: block_align: 0 2023-07-20T15:09:45.229 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.229 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.write_buffer_size: 33554432 2023-07-20T15:09:45.229 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.max_write_buffer_number: 2 2023-07-20T15:09:45.229 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compression: NoCompression 2023-07-20T15:09:45.230 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.bottommost_compression: Disabled 2023-07-20T15:09:45.230 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.prefix_extractor: nullptr 2023-07-20T15:09:45.230 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-20T15:09:45.230 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.num_levels: 7 2023-07-20T15:09:45.230 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-20T15:09:45.230 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-20T15:09:45.230 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-07-20T15:09:45.231 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-20T15:09:45.231 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-20T15:09:45.231 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-20T15:09:45.231 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-20T15:09:45.231 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-20T15:09:45.231 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-20T15:09:45.231 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compression_opts.window_bits: -14 2023-07-20T15:09:45.232 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compression_opts.level: 32767 2023-07-20T15:09:45.232 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compression_opts.strategy: 0 2023-07-20T15:09:45.232 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-20T15:09:45.232 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-20T15:09:45.232 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compression_opts.enabled: false 2023-07-20T15:09:45.232 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-20T15:09:45.233 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-20T15:09:45.233 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-20T15:09:45.233 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.target_file_size_base: 67108864 2023-07-20T15:09:45.233 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.target_file_size_multiplier: 1 2023-07-20T15:09:45.233 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-20T15:09:45.233 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-20T15:09:45.233 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-20T15:09:45.234 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-20T15:09:45.234 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-20T15:09:45.234 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-20T15:09:45.234 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-20T15:09:45.234 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-20T15:09:45.234 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-20T15:09:45.234 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-20T15:09:45.235 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-20T15:09:45.235 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-20T15:09:45.235 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.arena_block_size: 4194304 2023-07-20T15:09:45.235 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-20T15:09:45.235 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-20T15:09:45.235 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-07-20T15:09:45.235 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.disable_auto_compactions: 0 2023-07-20T15:09:45.235 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-20T15:09:45.236 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-20T15:09:45.236 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-20T15:09:45.236 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-20T15:09:45.236 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-20T15:09:45.236 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-20T15:09:45.236 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-20T15:09:45.237 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-20T15:09:45.237 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-20T15:09:45.237 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-20T15:09:45.237 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.table_properties_collectors: 2023-07-20T15:09:45.237 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.inplace_update_support: 0 2023-07-20T15:09:45.237 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-07-20T15:09:45.238 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-20T15:09:45.238 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-20T15:09:45.238 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.memtable_huge_page_size: 0 2023-07-20T15:09:45.238 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.bloom_locality: 0 2023-07-20T15:09:45.238 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.max_successive_merges: 0 2023-07-20T15:09:45.238 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-07-20T15:09:45.239 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.paranoid_file_checks: 0 2023-07-20T15:09:45.239 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.force_consistency_checks: 0 2023-07-20T15:09:45.239 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.report_bg_io_stats: 0 2023-07-20T15:09:45.239 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.ttl: 2592000 2023-07-20T15:09:45.239 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-07-20T15:09:45.239 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 27, last_sequence is 9522, log_number is 22,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-07-20T15:09:45.240 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.240 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.792+0000 7f57d50fa880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 22 2023-07-20T15:09:45.240 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.240 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.793+0000 7f57d50fa880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689865784793244, "job": 1, "event": "recovery_started", "log_files": [22]} 2023-07-20T15:09:45.240 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.793+0000 7f57d50fa880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #22 mode 2 2023-07-20T15:09:45.240 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 systemd[1]: Started Ceph mon.c for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:09:45.241 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.793+0000 7f57d50fa880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-07-20T15:09:45.241 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.794+0000 7f57d50fa880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689865784794770, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 256556, "table_properties": {"data_size": 255294, "index_size": 252, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 197, "raw_key_size": 694, "raw_average_key_size": 24, "raw_value_size": 254540, "raw_average_value_size": 9090, "num_data_blocks": 8, "num_entries": 28, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1689865784, "oldest_key_time": 3, "file_creation_time": 0}} 2023-07-20T15:09:45.241 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.794+0000 7f57d50fa880 4 rocksdb: [version_set.cc:3826] Creating manifest 28 2023-07-20T15:09:45.241 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.241 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.794+0000 7f57d50fa880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689865784795180, "job": 1, "event": "recovery_finished"} 2023-07-20T15:09:45.241 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.795+0000 7f57d50fa880 4 rocksdb: DB pointer 0x5604abe0f800 2023-07-20T15:09:45.241 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.795+0000 7f57bbf02700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2023-07-20T15:09:45.242 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.795+0000 7f57bbf02700 4 rocksdb: [db_impl/db_impl.cc:851] 2023-07-20T15:09:45.242 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: ** DB Stats ** 2023-07-20T15:09:45.242 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-20T15:09:45.242 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-20T15:09:45.242 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-20T15:09:45.242 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-20T15:09:45.242 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-20T15:09:45.243 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-07-20T15:09:45.243 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-20T15:09:45.243 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.243 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: ** Compaction Stats [default] ** 2023-07-20T15:09:45.243 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T15:09:45.243 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T15:09:45.243 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: L0 1/0 250.54 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 255.7 0.00 0.00 1 0.001 0 0 2023-07-20T15:09:45.243 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: L6 2/0 67.74 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-07-20T15:09:45.244 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Sum 3/0 67.98 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 255.7 0.00 0.00 1 0.001 0 0 2023-07-20T15:09:45.244 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 255.7 0.00 0.00 1 0.001 0 0 2023-07-20T15:09:45.244 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.244 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: ** Compaction Stats [default] ** 2023-07-20T15:09:45.244 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T15:09:45.244 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T15:09:45.245 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 255.7 0.00 0.00 1 0.001 0 0 2023-07-20T15:09:45.245 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-20T15:09:45.245 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Flush(GB): cumulative 0.000, interval 0.000 2023-07-20T15:09:45.245 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-20T15:09:45.245 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: AddFile(Total Files): cumulative 0, interval 0 2023-07-20T15:09:45.245 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: AddFile(L0 Files): cumulative 0, interval 0 2023-07-20T15:09:45.245 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: AddFile(Keys): cumulative 0, interval 0 2023-07-20T15:09:45.246 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Cumulative compaction: 0.00 GB write, 64.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T15:09:45.246 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Interval compaction: 0.00 GB write, 64.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T15:09:45.246 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-20T15:09:45.246 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.246 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: ** File Read Latency Histogram By Level [default] ** 2023-07-20T15:09:45.246 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.247 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: ** Compaction Stats [default] ** 2023-07-20T15:09:45.247 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T15:09:45.247 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T15:09:45.247 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: L0 1/0 250.54 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 255.7 0.00 0.00 1 0.001 0 0 2023-07-20T15:09:45.247 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: L6 2/0 67.74 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-07-20T15:09:45.247 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Sum 3/0 67.98 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 255.7 0.00 0.00 1 0.001 0 0 2023-07-20T15:09:45.247 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-07-20T15:09:45.248 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.248 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: ** Compaction Stats [default] ** 2023-07-20T15:09:45.248 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T15:09:45.248 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T15:09:45.248 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 255.7 0.00 0.00 1 0.001 0 0 2023-07-20T15:09:45.248 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-20T15:09:45.249 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Flush(GB): cumulative 0.000, interval 0.000 2023-07-20T15:09:45.249 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-20T15:09:45.249 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: AddFile(Total Files): cumulative 0, interval 0 2023-07-20T15:09:45.249 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: AddFile(L0 Files): cumulative 0, interval 0 2023-07-20T15:09:45.249 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: AddFile(Keys): cumulative 0, interval 0 2023-07-20T15:09:45.249 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Cumulative compaction: 0.00 GB write, 64.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T15:09:45.249 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T15:09:45.250 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-20T15:09:45.250 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.250 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: ** File Read Latency Histogram By Level [default] ** 2023-07-20T15:09:45.250 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.250 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.796+0000 7f57d50fa880 0 starting mon.c rank 1 at public addrs [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] at bind addrs [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T15:09:45.250 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.797+0000 7f57d50fa880 1 mon.c@-1(???) e3 preinit fsid 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T15:09:45.251 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.797+0000 7f57d50fa880 0 mon.c@-1(???).mds e1 new map 2023-07-20T15:09:45.251 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.797+0000 7f57d50fa880 0 mon.c@-1(???).mds e1 print_map 2023-07-20T15:09:45.251 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: e1 2023-07-20T15:09:45.251 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: enable_multiple, ever_enabled_multiple: 0,0 2023-07-20T15:09:45.251 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-20T15:09:45.251 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: legacy client fscid: -1 2023-07-20T15:09:45.251 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.252 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: No filesystems configured 2023-07-20T15:09:45.252 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: 2023-07-20T15:09:45.252 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.797+0000 7f57d50fa880 0 mon.c@-1(???).osd e78 crush map has features 3314933000852226048, adjusting msgr requires 2023-07-20T15:09:45.252 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.797+0000 7f57d50fa880 0 mon.c@-1(???).osd e78 crush map has features 288514051259236352, adjusting msgr requires 2023-07-20T15:09:45.252 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.797+0000 7f57d50fa880 0 mon.c@-1(???).osd e78 crush map has features 288514051259236352, adjusting msgr requires 2023-07-20T15:09:45.252 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.797+0000 7f57d50fa880 0 mon.c@-1(???).osd e78 crush map has features 288514051259236352, adjusting msgr requires 2023-07-20T15:09:45.252 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:42.046936+0000 mgr.y (mgr.34784) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:45.253 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:09:42.255059+0000 mgr.y (mgr.34784) 8 : cephadm [INF] Upgrade: Updating mon.c 2023-07-20T15:09:45.253 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:42.255436+0000 mon.c (mon.1) 234 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.c"}]: dispatch 2023-07-20T15:09:45.253 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:42.259361+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:45.253 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:42.260810+0000 mon.c (mon.1) 235 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:45.253 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:42.261419+0000 mon.c (mon.1) 236 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:45.253 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:42.261984+0000 mon.c (mon.1) 237 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:45.253 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:09:42.262566+0000 mgr.y (mgr.34784) 9 : cephadm [INF] Deploying daemon mon.c on smithi029 2023-07-20T15:09:45.254 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:42.262953+0000 mon.c (mon.1) 238 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2023-07-20T15:09:45.254 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:09:44.798+0000 7f57d50fa880 1 mon.c@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2023-07-20T15:09:46.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:46 smithi178 bash[104918]: cluster 2023-07-20T15:09:44.047278+0000 mgr.y (mgr.34784) 10 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:46.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:46 smithi178 bash[104918]: audit 2023-07-20T15:09:44.837511+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"0c199917352e\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"cpu_percentage\": \"2.08%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2023-07-20T15:09:40.880506Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T15:09:21.087946Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"cpu_percentage\": \"27.01%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:40.880648Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"service_name\": \"mon\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880790Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880856Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880920Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880984Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.881046Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"cpu_percentage\": \"0.30%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:40.881109Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.881171Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:42.262465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:18.789697Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:46.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:46 smithi178 bash[104918]: cluster 2023-07-20T15:09:45.007384+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2023-07-20T15:09:46.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:46 smithi178 bash[104918]: cluster 2023-07-20T15:09:45.548748+0000 mon.a (mon.0) 29 : cluster [INF] mon.a calling monitor election 2023-07-20T15:09:46.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:46 smithi178 bash[104918]: cluster 2023-07-20T15:09:45.550572+0000 mon.a (mon.0) 30 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-20T15:09:46.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:46 smithi178 bash[104918]: cluster 2023-07-20T15:09:45.556072+0000 mon.a (mon.0) 31 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],b=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0],c=[v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0]} removed_ranks: {} 2023-07-20T15:09:46.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:46 smithi178 bash[104918]: cluster 2023-07-20T15:09:45.568837+0000 mon.a (mon.0) 32 : cluster [DBG] fsmap 2023-07-20T15:09:46.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:46 smithi178 bash[104918]: cluster 2023-07-20T15:09:45.568891+0000 mon.a (mon.0) 33 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2023-07-20T15:09:46.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:46 smithi178 bash[104918]: cluster 2023-07-20T15:09:45.569313+0000 mon.a (mon.0) 34 : cluster [DBG] mgrmap e30: y(active, since 15s), standbys: x 2023-07-20T15:09:46.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:46 smithi178 bash[104918]: cluster 2023-07-20T15:09:45.572931+0000 mon.a (mon.0) 35 : cluster [INF] overall HEALTH_OK 2023-07-20T15:09:46.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:46 smithi178 bash[104918]: audit 2023-07-20T15:09:45.575631+0000 mon.a (mon.0) 36 : audit [INF] from='mgr.34784 ' entity='' 2023-07-20T15:09:46.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:46 smithi178 bash[104918]: audit 2023-07-20T15:09:45.577182+0000 mon.b (mon.2) 168 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:46.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:46 smithi178 bash[104918]: audit 2023-07-20T15:09:45.579347+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:09:46.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:46 smithi178 bash[104918]: cluster 2023-07-20T15:09:46.047704+0000 mgr.y (mgr.34784) 11 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:46.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:44.047278+0000 mgr.y (mgr.34784) 10 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:46.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:44.047278+0000 mgr.y (mgr.34784) 10 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:46.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:44.837511+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"0c199917352e\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"cpu_percentage\": \"2.08%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2023-07-20T15:09:40.880506Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T15:09:21.087946Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"cpu_percentage\": \"27.01%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:40.880648Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"service_name\": \"mon\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880790Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880856Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880920Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880984Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.881046Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"cpu_percentage\": \"0.30%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:40.881109Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.881171Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_request 2023-07-20T15:09:46.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: s\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:42.262465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:18.789697Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:46.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:44.837511+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"0c199917352e\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"cpu_percentage\": \"2.08%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2023-07-20T15:09:40.880506Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T15:09:21.087946Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"cpu_percentage\": \"27.01%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:40.880648Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"service_name\": \"mon\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880790Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.62%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880856Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.46%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880920Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.880984Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\", \"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\"], \"cpu_percentage\": \"0.38%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.881046Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\", \"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\"], \"cpu_percentage\": \"0.30%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2023-07-20T15:09:40.881109Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:40.881171Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:42.262465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:18.789697Z\"}}, \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:46.955 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:45.007384+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2023-07-20T15:09:46.955 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:45.548748+0000 mon.a (mon.0) 29 : cluster [INF] mon.a calling monitor election 2023-07-20T15:09:46.955 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:45.550572+0000 mon.a (mon.0) 30 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-20T15:09:46.955 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:45.556072+0000 mon.a (mon.0) 31 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],b=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0],c=[v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0]} removed_ranks: {} 2023-07-20T15:09:46.956 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:45.568837+0000 mon.a (mon.0) 32 : cluster [DBG] fsmap 2023-07-20T15:09:46.956 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:45.568891+0000 mon.a (mon.0) 33 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2023-07-20T15:09:46.956 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:45.569313+0000 mon.a (mon.0) 34 : cluster [DBG] mgrmap e30: y(active, since 15s), standbys: x 2023-07-20T15:09:46.956 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:45.572931+0000 mon.a (mon.0) 35 : cluster [INF] overall HEALTH_OK 2023-07-20T15:09:46.956 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:45.575631+0000 mon.a (mon.0) 36 : audit [INF] from='mgr.34784 ' entity='' 2023-07-20T15:09:46.956 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:45.577182+0000 mon.b (mon.2) 168 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:46.956 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:45.579347+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:09:46.957 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:46.047704+0000 mgr.y (mgr.34784) 11 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:46.957 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:45.007384+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2023-07-20T15:09:46.957 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:45.548748+0000 mon.a (mon.0) 29 : cluster [INF] mon.a calling monitor election 2023-07-20T15:09:46.957 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:45.550572+0000 mon.a (mon.0) 30 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-20T15:09:46.957 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:45.556072+0000 mon.a (mon.0) 31 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],b=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0],c=[v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0]} removed_ranks: {} 2023-07-20T15:09:46.957 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:45.568837+0000 mon.a (mon.0) 32 : cluster [DBG] fsmap 2023-07-20T15:09:46.958 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:45.568891+0000 mon.a (mon.0) 33 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2023-07-20T15:09:46.958 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:45.569313+0000 mon.a (mon.0) 34 : cluster [DBG] mgrmap e30: y(active, since 15s), standbys: x 2023-07-20T15:09:46.958 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:45.572931+0000 mon.a (mon.0) 35 : cluster [INF] overall HEALTH_OK 2023-07-20T15:09:46.958 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:45.575631+0000 mon.a (mon.0) 36 : audit [INF] from='mgr.34784 ' entity='' 2023-07-20T15:09:46.958 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:45.577182+0000 mon.b (mon.2) 168 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:46.958 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:45.579347+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:09:46.958 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:46.047704+0000 mgr.y (mgr.34784) 11 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:49.225 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:49 smithi178 bash[104918]: cluster 2023-07-20T15:09:48.048578+0000 mgr.y (mgr.34784) 12 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:49.225 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:49 smithi178 bash[104918]: audit 2023-07-20T15:09:48.540562+0000 mon.b (mon.2) 170 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"0c199917352e\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 124465971, \"cpu_percentage\": \"2.71%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2023-07-20T15:09:48.538313Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T15:09:21.087946Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 444491366, \"cpu_percentage\": \"23.49%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:48.538462Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"service_name\": \"mon\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"35b78756c758\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 22303211, \"cpu_percentage\": \"6.71%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2023-07-20T15:09:48.538537Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:09:44.585144Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 79555461, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538607Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 82806046, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538671Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 66647490, \"cpu_percentage\": \"0.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538732Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 82774589, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538793Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 13799260, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538853Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\", \"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\"], \"memory_usage\": 19807600, \"cpu_percentage\": \"0.32%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538913Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 56958648, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538974Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:42.262465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:18.789697Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:48.539090Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:49.226 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:49 smithi178 bash[104918]: audit 2023-07-20T15:09:48.544676+0000 mon.a (mon.0) 37 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:49.226 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:49 smithi178 bash[104918]: audit 2023-07-20T15:09:48.547155+0000 mon.b (mon.2) 171 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:49.226 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:49 smithi178 bash[104918]: audit 2023-07-20T15:09:48.549574+0000 mon.a (mon.0) 38 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:49.226 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:49 smithi178 bash[104918]: audit 2023-07-20T15:09:48.555234+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:49.226 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:49 smithi178 bash[104918]: audit 2023-07-20T15:09:48.556533+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:49.226 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:49 smithi178 bash[104918]: audit 2023-07-20T15:09:48.558517+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:09:49.227 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:49 smithi178 bash[104918]: audit 2023-07-20T15:09:48.559655+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-07-20T15:09:49.227 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:49 smithi178 bash[104918]: audit 2023-07-20T15:09:48.560379+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2023-07-20T15:09:49.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:48.048578+0000 mgr.y (mgr.34784) 12 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:49.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:48.048578+0000 mgr.y (mgr.34784) 12 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:49.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:48.540562+0000 mon.b (mon.2) 170 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"0c199917352e\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 124465971, \"cpu_percentage\": \"2.71%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2023-07-20T15:09:48.538313Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T15:09:21.087946Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 444491366, \"cpu_percentage\": \"23.49%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:48.538462Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"service_name\": \"mon\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"35b78756c758\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 22303211, \"cpu_percentage\": \"6.71%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2023-07-20T15:09:48.538537Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:09:44.585144Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 79555461, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538607Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 82806046, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538671Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 66647490, \"cpu_percentage\": \"0.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538732Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 82774589, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538793Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 13799260, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538853Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\", \"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\"], \"memory_usage\": 19807600, \"cpu_percentage\": \"0.32%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538913Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image 2023-07-20T15:09:49.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:48.540562+0000 mon.b (mon.2) 170 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi029","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi029\", \"container_id\": \"0c199917352e\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 124465971, \"cpu_percentage\": \"2.71%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2023-07-20T15:09:48.538313Z\", \"created\": \"2023-07-20T14:59:41.218166Z\", \"started\": \"2023-07-20T15:09:21.087946Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi029\", \"container_id\": \"891723c152d4\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 444491366, \"cpu_percentage\": \"23.49%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2023-07-20T15:09:48.538462Z\", \"created\": \"2023-07-20T14:59:45.594094Z\", \"started\": \"2023-07-20T15:08:43.211560Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"service_name\": \"mon\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi029\", \"container_id\": \"35b78756c758\", \"container_image_id\": \"247668761b277ca488b37692f2784aa84f28dda989bf9a1c08ffee06cf13b01f\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d\"], \"memory_usage\": 22303211, \"cpu_percentage\": \"6.71%\", \"version\": \"16.2.13-355-ge2018073\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2023-07-20T15:09:48.538537Z\", \"created\": \"2023-07-20T15:00:58.427889Z\", \"started\": \"2023-07-20T15:09:44.585144Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi029\", \"container_id\": \"a30d27a6dc87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 79555461, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538607Z\", \"created\": \"2023-07-20T15:01:38.550226Z\", \"started\": \"2023-07-20T15:01:52.365112Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi029\", \"container_id\": \"81d19bc55e70\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 82806046, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538671Z\", \"created\": \"2023-07-20T15:01:53.091986Z\", \"started\": \"2023-07-20T15:02:07.462619Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi029\", \"container_id\": \"d60b18f8f253\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 66647490, \"cpu_percentage\": \"0.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538732Z\", \"created\": \"2023-07-20T15:02:07.804744Z\", \"started\": \"2023-07-20T15:02:22.415537Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi029\", \"container_id\": \"0a92a9e1f2da\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 82774589, \"cpu_percentage\": \"0.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538793Z\", \"created\": \"2023-07-20T15:02:22.504502Z\", \"started\": \"2023-07-20T15:02:23.834728Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi029\", \"container_id\": \"a2b5070c8a7f\", \"container_image_id\": \"458e026e6aa62a8da4522cb09766da69d7365ebeb456d5a43a214fc6bd232a3c\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:81f94e50ea37a88dfee849d0f4acad25b96b397061f59e5095905f6bc5829637\", \"docker.io/prom/node-exporter@sha256:40ba9ef2dc8d7564d76656feca7f679062d2df71653618211d38c0ec51ebc28c\"], \"memory_usage\": 13799260, \"cpu_percentage\": \"0.39%\", \"version\": \"1.6.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538853Z\", \"created\": \"2023-07-20T15:03:36.718285Z\", \"started\": \"2023-07-20T15:03:40.287309Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi029\", \"container_id\": \"27a8d3f42bb2\", \"container_image_id\": \"c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:fd4d9a3dd1fd0125108417be21be917f19cc76262347086509a0d43f29b80e98\", \"docker.io/prom/alertmanager@sha256:db8303fa05341f5dc6b19b36a97325cd1b8307254ed9042a2c554af71f3c0284\"], \"memory_usage\": 19807600, \"cpu_percentage\": \"0.32%\", \"version\": \"0.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538913Z\", \"created\": \"2023-07-20T15:03:43.223179Z\", \"started\": \"2023-07-20T15:08:19.353891Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi029.fdztmk\", \"daemon_name\": \"rgw.r.z.smithi029.fdztmk\", \"hostname\": \"smithi029\", \"container_id\": \"45851ddbab0f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image 2023-07-20T15:09:49.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: _name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 56958648, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538974Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:42.262465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:18.789697Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:48.539090Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:49.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:48.544676+0000 mon.a (mon.0) 37 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:49.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:48.547155+0000 mon.b (mon.2) 171 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:49.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:48.549574+0000 mon.a (mon.0) 38 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:49.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:48.555234+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:49.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:48.556533+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:49.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:48.558517+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:09:49.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:48.559655+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-07-20T15:09:49.456 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:48.560379+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2023-07-20T15:09:49.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: _name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 56958648, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2023-07-20T15:09:48.538974Z\", \"created\": \"2023-07-20T15:04:37.533288Z\", \"started\": \"2023-07-20T15:04:37.674999Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921313Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4d7d62a7-fee8-4b91-aaef-43c33da61525\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"Mkmm7P-f99y-xxUN-m6ab-jfGJ-Y54z-Q1VjjO\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2a028cba-0ec6-4032-96ef-177180fe78cb\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"sUT2sN-9njY-Lnfk-rObr-nS5e-YkBf-vilF3L\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0f51402c-d77b-420c-801b-5b204f09a8cf\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"ZDHBqt-e1OW-7i4Z-fwDI-wMst-sUBi-UO1yhM\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f8465b78-5108-4a6c-8741-1aacec147eb7\", \"cluster_fsid\": \"021c9860-270e-11ee-9b34-001a4aab830c\", \"block_uuid\": \"lelGQB-FiM8-f5Ij-eG2o-zbJk-uOh0-RBdhnf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB7512009B480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"Hitachi HUA72101\", \"rev\": \"AJ0A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2023-07-20T15:07:56.921325Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"Hitachi_HUA72101_GTF000PAKEX1MF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:42.262465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2023-07-20T15:08:30.923819Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2023-07-20T15:01:49.121814Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:03.839424Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:18.709877Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2023-07-20T15:02:21.009048Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:03:36.129940Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2023-07-20T15:08:09.214691Z\"}, \"rgw.r.z.smithi029.fdztmk\": {\"deps\": [], \"last_config\": \"2023-07-20T15:04:36.257262Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2023-07-20T15:09:18.789697Z\"}}, \"last_daemon_update\": \"2023-07-20T15:09:48.539090Z\", \"last_device_update\": \"2023-07-20T15:02:25.192452Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2023-07-20T15:00:05.643031Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2023-07-20T15:09:49.456 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:48.544676+0000 mon.a (mon.0) 37 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:49.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:48.547155+0000 mon.b (mon.2) 171 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2023-07-20T15:09:49.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:48.549574+0000 mon.a (mon.0) 38 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:49.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:48.555234+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:49.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:48.556533+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2023-07-20T15:09:49.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:48.558517+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:09:49.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:48.559655+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-07-20T15:09:49.457 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:48.560379+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2023-07-20T15:09:50.153 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:49.804+0000 7fd67e5c7700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-20T15:09:50.154 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:50 smithi178 bash[104918]: cephadm 2023-07-20T15:09:48.560764+0000 mgr.y (mgr.34784) 13 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2023-07-20T15:09:50.154 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:50 smithi178 bash[104918]: audit 2023-07-20T15:09:49.530577+0000 mon.b (mon.2) 177 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.b"}]: dispatch 2023-07-20T15:09:50.154 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:50 smithi178 bash[104918]: audit 2023-07-20T15:09:49.535363+0000 mon.a (mon.0) 39 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:50.154 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:50 smithi178 bash[104918]: audit 2023-07-20T15:09:49.536642+0000 mon.b (mon.2) 178 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:50.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:50 smithi178 bash[104918]: audit 2023-07-20T15:09:49.537417+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:50.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:50 smithi178 bash[104918]: audit 2023-07-20T15:09:49.538475+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:50.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:50 smithi178 bash[104918]: audit 2023-07-20T15:09:49.539620+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2023-07-20T15:09:50.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:50 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:09:48.560764+0000 mgr.y (mgr.34784) 13 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2023-07-20T15:09:50.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:50 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:49.530577+0000 mon.b (mon.2) 177 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.b"}]: dispatch 2023-07-20T15:09:50.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:50 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:49.535363+0000 mon.a (mon.0) 39 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:50.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:50 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:49.536642+0000 mon.b (mon.2) 178 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:50.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:50 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:49.537417+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:50.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:50 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:49.538475+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:50.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:50 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:49.539620+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2023-07-20T15:09:50.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:50 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:09:48.560764+0000 mgr.y (mgr.34784) 13 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2023-07-20T15:09:50.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:50 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:49.530577+0000 mon.b (mon.2) 177 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.b"}]: dispatch 2023-07-20T15:09:50.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:50 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:49.535363+0000 mon.a (mon.0) 39 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:50.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:50 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:49.536642+0000 mon.b (mon.2) 178 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:50.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:50 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:49.537417+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:50.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:50 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:49.538475+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:50.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:50 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:49.539620+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2023-07-20T15:09:50.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:50 smithi178 systemd[1]: Stopping Ceph mon.b for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:09:50.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:50 smithi178 bash[104918]: debug 2023-07-20T15:09:50.645+0000 7f9e1ecff700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T15:09:51.030 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:50 smithi178 bash[104918]: debug 2023-07-20T15:09:50.645+0000 7f9e1ecff700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-07-20T15:09:51.290 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:51 smithi178 bash[125307]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon.b 2023-07-20T15:09:51.632 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:51 smithi178 bash[125359]: Error: no container with name or ID "ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon.b" found: no such container 2023-07-20T15:09:51.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:51 smithi178 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.b.service: Succeeded. 2023-07-20T15:09:51.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:51 smithi178 systemd[1]: Stopped Ceph mon.b for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:09:51.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:51 smithi178 systemd[1]: Starting Ceph mon.b for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:09:52.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.080+0000 7fd006dfb880 0 set uid:gid to 167:167 (ceph:ceph) 2023-07-20T15:09:52.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.080+0000 7fd006dfb880 0 ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable), process ceph-mon, pid 7 2023-07-20T15:09:52.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.080+0000 7fd006dfb880 0 pidfile_write: ignore empty --pid-file 2023-07-20T15:09:52.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 0 load: jerasure load: lrc load: isa 2023-07-20T15:09:52.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: RocksDB version: 6.8.1 2023-07-20T15:09:52.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-07-20T15:09:52.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Compile date Jul 18 2023 2023-07-20T15:09:52.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: DB SUMMARY 2023-07-20T15:09:52.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: CURRENT file: CURRENT 2023-07-20T15:09:52.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: IDENTITY file: IDENTITY 2023-07-20T15:09:52.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 835 Bytes 2023-07-20T15:09:52.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 2, files: 000024.sst 000025.sst 2023-07-20T15:09:52.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000022.log size: 1329719 ; 2023-07-20T15:09:52.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.error_if_exists: 0 2023-07-20T15:09:52.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.create_if_missing: 0 2023-07-20T15:09:52.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.paranoid_checks: 1 2023-07-20T15:09:52.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.env: 0x55a7f80c9080 2023-07-20T15:09:52.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.fs: Posix File System 2023-07-20T15:09:52.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.info_log: 0x55a7f9def960 2023-07-20T15:09:52.427 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.max_file_opening_threads: 16 2023-07-20T15:09:52.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.statistics: (nil) 2023-07-20T15:09:52.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.use_fsync: 0 2023-07-20T15:09:52.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.max_log_file_size: 0 2023-07-20T15:09:52.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-20T15:09:52.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.log_file_time_to_roll: 0 2023-07-20T15:09:52.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.keep_log_file_num: 1000 2023-07-20T15:09:52.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.recycle_log_file_num: 0 2023-07-20T15:09:52.429 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.allow_fallocate: 1 2023-07-20T15:09:52.429 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.allow_mmap_reads: 0 2023-07-20T15:09:52.429 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.allow_mmap_writes: 0 2023-07-20T15:09:52.429 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.use_direct_reads: 0 2023-07-20T15:09:52.429 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-20T15:09:52.429 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.create_missing_column_families: 0 2023-07-20T15:09:52.429 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.db_log_dir: 2023-07-20T15:09:52.429 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2023-07-20T15:09:52.430 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.table_cache_numshardbits: 6 2023-07-20T15:09:52.430 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.max_subcompactions: 1 2023-07-20T15:09:52.430 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.max_background_flushes: -1 2023-07-20T15:09:52.430 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-07-20T15:09:52.430 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-07-20T15:09:52.430 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-07-20T15:09:52.430 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-20T15:09:52.431 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-07-20T15:09:52.431 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.advise_random_on_open: 1 2023-07-20T15:09:52.431 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.db_write_buffer_size: 0 2023-07-20T15:09:52.431 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.write_buffer_manager: 0x55a7faaea1b0 2023-07-20T15:09:52.431 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-20T15:09:52.431 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-07-20T15:09:52.431 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-20T15:09:52.431 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.use_adaptive_mutex: 0 2023-07-20T15:09:52.432 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.rate_limiter: (nil) 2023-07-20T15:09:52.432 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-20T15:09:52.432 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.wal_recovery_mode: 2 2023-07-20T15:09:52.432 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.enable_thread_tracking: 0 2023-07-20T15:09:52.432 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.enable_pipelined_write: 0 2023-07-20T15:09:52.432 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.unordered_write: 0 2023-07-20T15:09:52.432 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-20T15:09:52.433 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-20T15:09:52.433 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-20T15:09:52.433 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-20T15:09:52.433 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.row_cache: None 2023-07-20T15:09:52.433 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.wal_filter: None 2023-07-20T15:09:52.433 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-20T15:09:52.433 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.allow_ingest_behind: 0 2023-07-20T15:09:52.433 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.preserve_deletes: 0 2023-07-20T15:09:52.434 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.two_write_queues: 0 2023-07-20T15:09:52.434 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.manual_wal_flush: 0 2023-07-20T15:09:52.434 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.atomic_flush: 0 2023-07-20T15:09:52.434 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-20T15:09:52.434 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.persist_stats_to_disk: 0 2023-07-20T15:09:52.434 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-07-20T15:09:52.434 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.log_readahead_size: 0 2023-07-20T15:09:52.434 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2023-07-20T15:09:52.435 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.max_background_jobs: 2 2023-07-20T15:09:52.435 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.max_background_compactions: -1 2023-07-20T15:09:52.435 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.085+0000 7fd006dfb880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-20T15:09:52.435 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-20T15:09:52.435 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.delayed_write_rate : 16777216 2023-07-20T15:09:52.435 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.max_total_wal_size: 0 2023-07-20T15:09:52.435 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-20T15:09:52.435 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.stats_dump_period_sec: 600 2023-07-20T15:09:52.436 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.stats_persist_period_sec: 600 2023-07-20T15:09:52.436 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-20T15:09:52.436 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.max_open_files: -1 2023-07-20T15:09:52.436 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.bytes_per_sync: 0 2023-07-20T15:09:52.436 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-07-20T15:09:52.436 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-07-20T15:09:52.436 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compaction_readahead_size: 0 2023-07-20T15:09:52.437 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Compression algorithms supported: 2023-07-20T15:09:52.437 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-20T15:09:52.437 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: kZSTD supported: 0 2023-07-20T15:09:52.437 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: kXpressCompression supported: 0 2023-07-20T15:09:52.437 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: kLZ4HCCompression supported: 1 2023-07-20T15:09:52.437 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: kLZ4Compression supported: 1 2023-07-20T15:09:52.437 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: kBZip2Compression supported: 0 2023-07-20T15:09:52.437 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: kZlibCompression supported: 1 2023-07-20T15:09:52.438 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: kSnappyCompression supported: 1 2023-07-20T15:09:52.438 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-07-20T15:09:52.438 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-07-20T15:09:52.438 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.438 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2023-07-20T15:09:52.438 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.438 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-20T15:09:52.440 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.merge_operator: 2023-07-20T15:09:52.440 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 bash[125501]: f38e8b21640dd9f850652a388388c038d514ee7b382cbe9daf4879ced11eac14 2023-07-20T15:09:52.440 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compaction_filter: None 2023-07-20T15:09:52.440 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compaction_filter_factory: None 2023-07-20T15:09:52.440 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-07-20T15:09:52.440 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.table_factory: BlockBasedTable 2023-07-20T15:09:52.440 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a7f9d9fd18) 2023-07-20T15:09:52.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cache_index_and_filter_blocks: 1 2023-07-20T15:09:52.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cache_index_and_filter_blocks_with_high_priority: 0 2023-07-20T15:09:52.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-20T15:09:52.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: pin_top_level_index_and_filter: 1 2023-07-20T15:09:52.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: index_type: 0 2023-07-20T15:09:52.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: data_block_index_type: 0 2023-07-20T15:09:52.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: index_shortening: 1 2023-07-20T15:09:52.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: data_block_hash_table_util_ratio: 0.750000 2023-07-20T15:09:52.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: hash_index_allow_collision: 1 2023-07-20T15:09:52.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: checksum: 1 2023-07-20T15:09:52.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: no_block_cache: 0 2023-07-20T15:09:52.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: block_cache: 0x55a7f9dd4f10 2023-07-20T15:09:52.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: block_cache_name: BinnedLRUCache 2023-07-20T15:09:52.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: block_cache_options: 2023-07-20T15:09:52.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: capacity : 536870912 2023-07-20T15:09:52.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: num_shard_bits : 4 2023-07-20T15:09:52.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: strict_capacity_limit : 0 2023-07-20T15:09:52.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: high_pri_pool_ratio: 0.000 2023-07-20T15:09:52.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: block_cache_compressed: (nil) 2023-07-20T15:09:52.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: persistent_cache: (nil) 2023-07-20T15:09:52.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: block_size: 4096 2023-07-20T15:09:52.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: block_size_deviation: 10 2023-07-20T15:09:52.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: block_restart_interval: 16 2023-07-20T15:09:52.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: index_block_restart_interval: 1 2023-07-20T15:09:52.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: metadata_block_size: 4096 2023-07-20T15:09:52.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: partition_filters: 0 2023-07-20T15:09:52.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: use_delta_encoding: 1 2023-07-20T15:09:52.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: filter_policy: rocksdb.BuiltinBloomFilter 2023-07-20T15:09:52.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: whole_key_filtering: 1 2023-07-20T15:09:52.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: verify_compression: 0 2023-07-20T15:09:52.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: read_amp_bytes_per_bit: 0 2023-07-20T15:09:52.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: format_version: 2 2023-07-20T15:09:52.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: enable_index_compression: 1 2023-07-20T15:09:52.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: block_align: 0 2023-07-20T15:09:52.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.write_buffer_size: 33554432 2023-07-20T15:09:52.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.max_write_buffer_number: 2 2023-07-20T15:09:52.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compression: NoCompression 2023-07-20T15:09:52.446 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.bottommost_compression: Disabled 2023-07-20T15:09:52.446 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.prefix_extractor: nullptr 2023-07-20T15:09:52.446 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-20T15:09:52.446 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.num_levels: 7 2023-07-20T15:09:52.446 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-20T15:09:52.446 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-20T15:09:52.446 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-07-20T15:09:52.446 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-20T15:09:52.447 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-20T15:09:52.447 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-20T15:09:52.447 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-20T15:09:52.447 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-20T15:09:52.447 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-20T15:09:52.447 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compression_opts.window_bits: -14 2023-07-20T15:09:52.447 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compression_opts.level: 32767 2023-07-20T15:09:52.447 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compression_opts.strategy: 0 2023-07-20T15:09:52.448 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-20T15:09:52.448 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-20T15:09:52.448 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compression_opts.enabled: false 2023-07-20T15:09:52.448 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-20T15:09:52.448 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-20T15:09:52.448 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-20T15:09:52.448 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.target_file_size_base: 67108864 2023-07-20T15:09:52.449 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.target_file_size_multiplier: 1 2023-07-20T15:09:52.449 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-20T15:09:52.449 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-20T15:09:52.449 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-20T15:09:52.449 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-20T15:09:52.449 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-20T15:09:52.449 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-20T15:09:52.449 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-20T15:09:52.450 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-20T15:09:52.450 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-20T15:09:52.450 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-20T15:09:52.450 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-20T15:09:52.450 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-20T15:09:52.450 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.arena_block_size: 4194304 2023-07-20T15:09:52.450 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-20T15:09:52.450 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-20T15:09:52.451 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-07-20T15:09:52.451 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.disable_auto_compactions: 0 2023-07-20T15:09:52.451 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-20T15:09:52.451 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-20T15:09:52.451 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-20T15:09:52.451 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-20T15:09:52.451 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-20T15:09:52.451 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-20T15:09:52.452 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-20T15:09:52.452 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-20T15:09:52.452 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-20T15:09:52.452 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-20T15:09:52.452 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.table_properties_collectors: 2023-07-20T15:09:52.452 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.inplace_update_support: 0 2023-07-20T15:09:52.452 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-07-20T15:09:52.453 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-20T15:09:52.453 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-20T15:09:52.453 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.memtable_huge_page_size: 0 2023-07-20T15:09:52.453 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.bloom_locality: 0 2023-07-20T15:09:52.453 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.max_successive_merges: 0 2023-07-20T15:09:52.453 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-07-20T15:09:52.453 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.paranoid_file_checks: 0 2023-07-20T15:09:52.453 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.force_consistency_checks: 0 2023-07-20T15:09:52.454 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.report_bg_io_stats: 0 2023-07-20T15:09:52.454 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.ttl: 2592000 2023-07-20T15:09:52.454 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-07-20T15:09:52.454 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 27, last_sequence is 9429, log_number is 22,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-07-20T15:09:52.454 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.454 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.086+0000 7fd006dfb880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 22 2023-07-20T15:09:52.454 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.454 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.087+0000 7fd006dfb880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689865792087510, "job": 1, "event": "recovery_started", "log_files": [22]} 2023-07-20T15:09:52.455 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.087+0000 7fd006dfb880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #22 mode 2 2023-07-20T15:09:52.455 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.088+0000 7fd006dfb880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-07-20T15:09:52.455 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.090+0000 7fd006dfb880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689865792091065, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 869394, "table_properties": {"data_size": 867490, "index_size": 894, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 197, "raw_key_size": 1622, "raw_average_key_size": 23, "raw_value_size": 865581, "raw_average_value_size": 12729, "num_data_blocks": 29, "num_entries": 68, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1689865792, "oldest_key_time": 3, "file_creation_time": 0}} 2023-07-20T15:09:52.455 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.090+0000 7fd006dfb880 4 rocksdb: [version_set.cc:3826] Creating manifest 28 2023-07-20T15:09:52.455 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.455 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.091+0000 7fd006dfb880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689865792091583, "job": 1, "event": "recovery_finished"} 2023-07-20T15:09:52.455 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.091+0000 7fd006dfb880 4 rocksdb: DB pointer 0x55a7f9e9d800 2023-07-20T15:09:52.455 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 systemd[1]: Started Ceph mon.b for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:09:52.456 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.092+0000 7fcfedc03700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2023-07-20T15:09:52.456 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.092+0000 7fcfedc03700 4 rocksdb: [db_impl/db_impl.cc:851] 2023-07-20T15:09:52.456 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: ** DB Stats ** 2023-07-20T15:09:52.456 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-20T15:09:52.456 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-20T15:09:52.456 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-20T15:09:52.456 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-20T15:09:52.457 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-20T15:09:52.457 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-07-20T15:09:52.457 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-20T15:09:52.457 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.457 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: ** Compaction Stats [default] ** 2023-07-20T15:09:52.457 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T15:09:52.457 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T15:09:52.457 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: L0 1/0 849.02 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 378.1 0.00 0.00 1 0.002 0 0 2023-07-20T15:09:52.458 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: L6 2/0 67.74 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-07-20T15:09:52.458 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Sum 3/0 68.57 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 378.1 0.00 0.00 1 0.002 0 0 2023-07-20T15:09:52.458 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 378.1 0.00 0.00 1 0.002 0 0 2023-07-20T15:09:52.458 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.458 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: ** Compaction Stats [default] ** 2023-07-20T15:09:52.458 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T15:09:52.458 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T15:09:52.458 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 378.1 0.00 0.00 1 0.002 0 0 2023-07-20T15:09:52.459 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-20T15:09:52.459 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Flush(GB): cumulative 0.001, interval 0.001 2023-07-20T15:09:52.459 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-20T15:09:52.459 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: AddFile(Total Files): cumulative 0, interval 0 2023-07-20T15:09:52.459 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: AddFile(L0 Files): cumulative 0, interval 0 2023-07-20T15:09:52.459 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: AddFile(Keys): cumulative 0, interval 0 2023-07-20T15:09:52.459 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Cumulative compaction: 0.00 GB write, 140.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T15:09:52.460 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Interval compaction: 0.00 GB write, 140.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T15:09:52.460 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-20T15:09:52.460 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.460 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: ** File Read Latency Histogram By Level [default] ** 2023-07-20T15:09:52.460 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.460 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: ** Compaction Stats [default] ** 2023-07-20T15:09:52.460 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T15:09:52.460 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T15:09:52.461 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: L0 1/0 849.02 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 378.1 0.00 0.00 1 0.002 0 0 2023-07-20T15:09:52.461 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: L6 2/0 67.74 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-07-20T15:09:52.461 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Sum 3/0 68.57 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 378.1 0.00 0.00 1 0.002 0 0 2023-07-20T15:09:52.461 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-07-20T15:09:52.461 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.461 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: ** Compaction Stats [default] ** 2023-07-20T15:09:52.461 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-07-20T15:09:52.461 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-20T15:09:52.462 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 378.1 0.00 0.00 1 0.002 0 0 2023-07-20T15:09:52.462 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-20T15:09:52.462 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Flush(GB): cumulative 0.001, interval 0.000 2023-07-20T15:09:52.462 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-20T15:09:52.462 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: AddFile(Total Files): cumulative 0, interval 0 2023-07-20T15:09:52.462 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: AddFile(L0 Files): cumulative 0, interval 0 2023-07-20T15:09:52.462 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: AddFile(Keys): cumulative 0, interval 0 2023-07-20T15:09:52.462 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Cumulative compaction: 0.00 GB write, 139.79 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T15:09:52.463 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-20T15:09:52.463 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-20T15:09:52.463 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.463 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: ** File Read Latency Histogram By Level [default] ** 2023-07-20T15:09:52.463 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.464 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.092+0000 7fd006dfb880 0 starting mon.b rank 2 at public addrs [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] at bind addrs [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T15:09:52.464 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.094+0000 7fd006dfb880 1 mon.b@-1(???) e3 preinit fsid 021c9860-270e-11ee-9b34-001a4aab830c 2023-07-20T15:09:52.464 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.094+0000 7fd006dfb880 0 mon.b@-1(???).mds e1 new map 2023-07-20T15:09:52.464 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.094+0000 7fd006dfb880 0 mon.b@-1(???).mds e1 print_map 2023-07-20T15:09:52.465 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: e1 2023-07-20T15:09:52.465 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: enable_multiple, ever_enabled_multiple: 0,0 2023-07-20T15:09:52.465 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-20T15:09:52.465 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: legacy client fscid: -1 2023-07-20T15:09:52.465 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.465 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: No filesystems configured 2023-07-20T15:09:52.466 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: 2023-07-20T15:09:52.466 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.094+0000 7fd006dfb880 0 mon.b@-1(???).osd e78 crush map has features 3314933000852226048, adjusting msgr requires 2023-07-20T15:09:52.466 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.094+0000 7fd006dfb880 0 mon.b@-1(???).osd e78 crush map has features 288514051259236352, adjusting msgr requires 2023-07-20T15:09:52.466 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.094+0000 7fd006dfb880 0 mon.b@-1(???).osd e78 crush map has features 288514051259236352, adjusting msgr requires 2023-07-20T15:09:52.466 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.094+0000 7fd006dfb880 0 mon.b@-1(???).osd e78 crush map has features 288514051259236352, adjusting msgr requires 2023-07-20T15:09:52.466 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:09:48.560764+0000 mgr.y (mgr.34784) 13 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2023-07-20T15:09:52.466 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:49.530577+0000 mon.b (mon.2) 177 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:bac4c07d373cc72c8ea38784378978d6a4224770a32b26251cce380709208e4d", "who": "mon.b"}]: dispatch 2023-07-20T15:09:52.467 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:49.535363+0000 mon.a (mon.0) 39 : audit [INF] from='mgr.34784 ' entity='mgr.y' 2023-07-20T15:09:52.467 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:49.536642+0000 mon.b (mon.2) 178 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:52.467 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:49.537417+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:52.467 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:49.538475+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:52.467 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:49.539620+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2023-07-20T15:09:52.467 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:52 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:09:52.095+0000 7fd006dfb880 1 mon.b@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2023-07-20T15:09:53.292 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:52.049745+0000 mgr.y (mgr.34784) 17 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:53.292 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:52.242294+0000 mon.a (mon.0) 49 : cluster [INF] overall HEALTH_OK 2023-07-20T15:09:53.292 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:52.242966+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-20T15:09:53.292 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:52.243305+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2023-07-20T15:09:53.293 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:52.243349+0000 mon.a (mon.0) 51 : cluster [INF] mon.a calling monitor election 2023-07-20T15:09:53.293 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:52.243436+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2023-07-20T15:09:53.293 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:52.244644+0000 mon.a (mon.0) 52 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-20T15:09:53.293 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:52.244788+0000 mon.a (mon.0) 53 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-20T15:09:53.293 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:52.245175+0000 mon.a (mon.0) 54 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-20T15:09:53.293 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:52.248278+0000 mon.a (mon.0) 55 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],b=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0],c=[v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0]} removed_ranks: {} 2023-07-20T15:09:53.293 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:52.248754+0000 mon.a (mon.0) 56 : cluster [DBG] fsmap 2023-07-20T15:09:53.294 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:52.248802+0000 mon.a (mon.0) 57 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2023-07-20T15:09:53.294 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:52.249222+0000 mon.a (mon.0) 58 : cluster [DBG] mgrmap e30: y(active, since 22s), standbys: x 2023-07-20T15:09:53.294 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:52.252594+0000 mon.a (mon.0) 59 : cluster [INF] overall HEALTH_OK 2023-07-20T15:09:53.294 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:52.255166+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:53.611 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:53 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:09:52.049745+0000 mgr.y (mgr.34784) 17 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:53.612 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:53 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:09:52.242294+0000 mon.a (mon.0) 49 : cluster [INF] overall HEALTH_OK 2023-07-20T15:09:53.612 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:53 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:52.242966+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-20T15:09:53.612 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:53 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:09:52.243305+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2023-07-20T15:09:53.612 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:53 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:09:52.243349+0000 mon.a (mon.0) 51 : cluster [INF] mon.a calling monitor election 2023-07-20T15:09:53.612 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:53 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:09:52.243436+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2023-07-20T15:09:53.612 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:53 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:52.244644+0000 mon.a (mon.0) 52 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-20T15:09:53.612 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:53 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:52.244788+0000 mon.a (mon.0) 53 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-20T15:09:53.613 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:53 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:09:52.245175+0000 mon.a (mon.0) 54 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-20T15:09:53.613 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:53 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:09:52.248278+0000 mon.a (mon.0) 55 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],b=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0],c=[v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0]} removed_ranks: {} 2023-07-20T15:09:53.613 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:53 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:09:52.248754+0000 mon.a (mon.0) 56 : cluster [DBG] fsmap 2023-07-20T15:09:53.613 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:53 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:09:52.248802+0000 mon.a (mon.0) 57 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2023-07-20T15:09:53.613 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:53 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:09:52.249222+0000 mon.a (mon.0) 58 : cluster [DBG] mgrmap e30: y(active, since 22s), standbys: x 2023-07-20T15:09:53.613 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:53 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:09:52.252594+0000 mon.a (mon.0) 59 : cluster [INF] overall HEALTH_OK 2023-07-20T15:09:53.613 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:53 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:52.255166+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:53.614 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:53 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:52.256217+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:53.614 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:53 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:52.258036+0000 mon.a (mon.0) 62 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:09:53.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:52.256217+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:53.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:52.258036+0000 mon.a (mon.0) 62 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:09:53.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:52.049745+0000 mgr.y (mgr.34784) 17 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:53.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:52.242294+0000 mon.a (mon.0) 49 : cluster [INF] overall HEALTH_OK 2023-07-20T15:09:53.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:52.242966+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-20T15:09:53.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:52.243305+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2023-07-20T15:09:53.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:52.243349+0000 mon.a (mon.0) 51 : cluster [INF] mon.a calling monitor election 2023-07-20T15:09:53.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:52.243436+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2023-07-20T15:09:53.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:52.244644+0000 mon.a (mon.0) 52 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-20T15:09:53.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:52.244788+0000 mon.a (mon.0) 53 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-20T15:09:53.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:52.245175+0000 mon.a (mon.0) 54 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-20T15:09:53.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:52.248278+0000 mon.a (mon.0) 55 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],b=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0],c=[v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0]} removed_ranks: {} 2023-07-20T15:09:53.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:52.248754+0000 mon.a (mon.0) 56 : cluster [DBG] fsmap 2023-07-20T15:09:53.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:52.248802+0000 mon.a (mon.0) 57 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2023-07-20T15:09:53.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:52.249222+0000 mon.a (mon.0) 58 : cluster [DBG] mgrmap e30: y(active, since 22s), standbys: x 2023-07-20T15:09:53.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:52.252594+0000 mon.a (mon.0) 59 : cluster [INF] overall HEALTH_OK 2023-07-20T15:09:53.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:52.255166+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:53.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:52.256217+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:09:53.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:53 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:52.258036+0000 mon.a (mon.0) 62 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:09:55.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:55 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:09:54.050360+0000 mgr.y (mgr.34784) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:55.702 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:55 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:54.050360+0000 mgr.y (mgr.34784) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:55.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:55 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:54.050360+0000 mgr.y (mgr.34784) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:57.031 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:55.732280+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:57.031 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:55.736769+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:57.032 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:09:55.740027+0000 mgr.y (mgr.34784) 19 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2023-07-20T15:09:57.032 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:55.740356+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:57.032 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:55.741122+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:57.032 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:55.741827+0000 mon.a (mon.0) 67 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:57.032 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:09:55.742434+0000 mgr.y (mgr.34784) 20 : cephadm [INF] Reconfiguring daemon mon.a on smithi029 2023-07-20T15:09:57.032 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:55.742873+0000 mon.a (mon.0) 68 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2023-07-20T15:09:57.033 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:56.050946+0000 mgr.y (mgr.34784) 21 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:57.033 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:56.629050+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:57.033 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:56.630006+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:09:57.033 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:56.630721+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-20T15:09:57.033 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:56.631377+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:57.033 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:56.632193+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2023-07-20T15:09:57.033 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:55.732280+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:57.034 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:55.736769+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:57.034 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:09:55.740027+0000 mgr.y (mgr.34784) 19 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2023-07-20T15:09:57.034 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:55.740356+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:57.034 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:55.741122+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:57.034 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:55.741827+0000 mon.a (mon.0) 67 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:57.034 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:09:55.742434+0000 mgr.y (mgr.34784) 20 : cephadm [INF] Reconfiguring daemon mon.a on smithi029 2023-07-20T15:09:57.035 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:55.742873+0000 mon.a (mon.0) 68 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2023-07-20T15:09:57.035 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:56.050946+0000 mgr.y (mgr.34784) 21 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:57.035 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:56.629050+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:57.035 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:56.630006+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:09:57.035 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:56.630721+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-20T15:09:57.035 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:56.631377+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:57.036 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:56 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:56.632193+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2023-07-20T15:09:57.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:56 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:55.732280+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:57.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:56 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:55.736769+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:57.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:56 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:09:55.740027+0000 mgr.y (mgr.34784) 19 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2023-07-20T15:09:57.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:56 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:55.740356+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:57.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:56 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:55.741122+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:57.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:56 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:55.741827+0000 mon.a (mon.0) 67 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:57.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:56 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:09:55.742434+0000 mgr.y (mgr.34784) 20 : cephadm [INF] Reconfiguring daemon mon.a on smithi029 2023-07-20T15:09:57.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:56 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:55.742873+0000 mon.a (mon.0) 68 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2023-07-20T15:09:57.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:56 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:09:56.050946+0000 mgr.y (mgr.34784) 21 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:57.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:56 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:56.629050+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:57.175 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:56 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:56.630006+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:09:57.175 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:56 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:56.630721+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-20T15:09:57.175 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:56 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:56.631377+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:57.175 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:56 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:56.632193+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2023-07-20T15:09:57.409 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:09:57 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:09:57.100+0000 7fd67e5c7700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-20T15:09:58.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:58 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:09:56.629743+0000 mgr.y (mgr.34784) 22 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2023-07-20T15:09:58.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:58 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:09:56.631878+0000 mgr.y (mgr.34784) 23 : cephadm [INF] Reconfiguring daemon mgr.y on smithi029 2023-07-20T15:09:58.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:58 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:57.471701+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:58.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:58 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:57.472696+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:58.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:58 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:57.473252+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:58.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:58 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:57.473781+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:58.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:58 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:57.474624+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2023-07-20T15:09:58.452 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:58 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:09:56.629743+0000 mgr.y (mgr.34784) 22 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2023-07-20T15:09:58.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:58 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:09:56.631878+0000 mgr.y (mgr.34784) 23 : cephadm [INF] Reconfiguring daemon mgr.y on smithi029 2023-07-20T15:09:58.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:58 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:57.471701+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:58.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:58 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:57.472696+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:58.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:58 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:57.473252+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:58.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:58 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:57.473781+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:58.454 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:58 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:57.474624+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2023-07-20T15:09:58.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:58 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:09:56.629743+0000 mgr.y (mgr.34784) 22 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2023-07-20T15:09:58.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:58 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:09:56.631878+0000 mgr.y (mgr.34784) 23 : cephadm [INF] Reconfiguring daemon mgr.y on smithi029 2023-07-20T15:09:58.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:58 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:57.471701+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:58.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:58 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:57.472696+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:09:58.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:58 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:57.473252+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:09:58.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:58 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:57.473781+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:58.455 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:58 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:57.474624+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2023-07-20T15:09:59.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:59 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:09:57.472445+0000 mgr.y (mgr.34784) 24 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2023-07-20T15:09:59.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:59 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:09:57.474264+0000 mgr.y (mgr.34784) 25 : cephadm [INF] Reconfiguring daemon mon.c on smithi029 2023-07-20T15:09:59.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:59 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:09:58.051537+0000 mgr.y (mgr.34784) 26 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:59.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:59 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:58.361898+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:59.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:59 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:09:58.362616+0000 mgr.y (mgr.34784) 27 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2023-07-20T15:09:59.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:59 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:58.362867+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-20T15:09:59.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:59 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:58.363480+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:59.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:59 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:09:58.364507+0000 mgr.y (mgr.34784) 28 : cephadm [INF] Reconfiguring daemon osd.0 on smithi029 2023-07-20T15:09:59.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:59 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:58.364911+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2023-07-20T15:09:59.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:59 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:59.206937+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:59.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:59 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:59.207897+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-20T15:09:59.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:59 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:59.208471+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:59.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:09:59 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:09:59.209896+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2023-07-20T15:09:59.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:09:57.472445+0000 mgr.y (mgr.34784) 24 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2023-07-20T15:09:59.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:09:57.474264+0000 mgr.y (mgr.34784) 25 : cephadm [INF] Reconfiguring daemon mon.c on smithi029 2023-07-20T15:09:59.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:09:58.051537+0000 mgr.y (mgr.34784) 26 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:59.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:58.361898+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:59.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:09:58.362616+0000 mgr.y (mgr.34784) 27 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2023-07-20T15:09:59.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:58.362867+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-20T15:09:59.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:58.363480+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:59.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:09:58.364507+0000 mgr.y (mgr.34784) 28 : cephadm [INF] Reconfiguring daemon osd.0 on smithi029 2023-07-20T15:09:59.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:58.364911+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2023-07-20T15:09:59.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:59.206937+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:59.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:59.207897+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-20T15:09:59.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:59.208471+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:59.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:09:59.209896+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2023-07-20T15:09:59.705 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:09:57.472445+0000 mgr.y (mgr.34784) 24 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2023-07-20T15:09:59.705 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:09:57.474264+0000 mgr.y (mgr.34784) 25 : cephadm [INF] Reconfiguring daemon mon.c on smithi029 2023-07-20T15:09:59.705 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:09:58.051537+0000 mgr.y (mgr.34784) 26 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:09:59.705 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:58.361898+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:59.706 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:09:58.362616+0000 mgr.y (mgr.34784) 27 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2023-07-20T15:09:59.706 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:58.362867+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-20T15:09:59.706 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:58.363480+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:59.706 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:09:58.364507+0000 mgr.y (mgr.34784) 28 : cephadm [INF] Reconfiguring daemon osd.0 on smithi029 2023-07-20T15:09:59.706 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:58.364911+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2023-07-20T15:09:59.706 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:59.206937+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:09:59.706 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:59.207897+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-20T15:09:59.707 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:59.208471+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:09:59.707 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:09:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:09:59.209896+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2023-07-20T15:10:00.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:00 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:09:59.207673+0000 mgr.y (mgr.34784) 29 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2023-07-20T15:10:00.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:00 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:09:59.209470+0000 mgr.y (mgr.34784) 30 : cephadm [INF] Reconfiguring daemon osd.1 on smithi029 2023-07-20T15:10:00.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:00 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:00.000164+0000 mon.a (mon.0) 87 : cluster [INF] overall HEALTH_OK 2023-07-20T15:10:00.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:00 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:00.095430+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:00.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:00 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:00.096360+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-20T15:10:00.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:00 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:00.096924+0000 mon.a (mon.0) 90 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:00.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:00 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:00.098257+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2023-07-20T15:10:00.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:00 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:09:59.207673+0000 mgr.y (mgr.34784) 29 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2023-07-20T15:10:00.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:00 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:09:59.209470+0000 mgr.y (mgr.34784) 30 : cephadm [INF] Reconfiguring daemon osd.1 on smithi029 2023-07-20T15:10:00.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:00 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:00.000164+0000 mon.a (mon.0) 87 : cluster [INF] overall HEALTH_OK 2023-07-20T15:10:00.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:00 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:00.095430+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:00.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:00 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:00.096360+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-20T15:10:00.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:00 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:00.096924+0000 mon.a (mon.0) 90 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:00.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:00 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:00.098257+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2023-07-20T15:10:00.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:00 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:09:59.207673+0000 mgr.y (mgr.34784) 29 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2023-07-20T15:10:00.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:00 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:09:59.209470+0000 mgr.y (mgr.34784) 30 : cephadm [INF] Reconfiguring daemon osd.1 on smithi029 2023-07-20T15:10:00.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:00 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:00.000164+0000 mon.a (mon.0) 87 : cluster [INF] overall HEALTH_OK 2023-07-20T15:10:00.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:00 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:00.095430+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:00.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:00 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:00.096360+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-20T15:10:00.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:00 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:00.096924+0000 mon.a (mon.0) 90 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:00.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:00 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:00.098257+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2023-07-20T15:10:01.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:01 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:00.051859+0000 mgr.y (mgr.34784) 31 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:01.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:01 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:00.096118+0000 mgr.y (mgr.34784) 32 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2023-07-20T15:10:01.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:01 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:00.097881+0000 mgr.y (mgr.34784) 33 : cephadm [INF] Reconfiguring daemon osd.2 on smithi029 2023-07-20T15:10:01.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:01 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:01.016806+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:01.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:01 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:01.017751+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-20T15:10:01.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:01 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:01.018348+0000 mon.a (mon.0) 94 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:01.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:01 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:01.019668+0000 mon.a (mon.0) 95 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2023-07-20T15:10:01.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:01 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:00.051859+0000 mgr.y (mgr.34784) 31 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:01.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:01 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:00.096118+0000 mgr.y (mgr.34784) 32 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2023-07-20T15:10:01.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:01 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:00.097881+0000 mgr.y (mgr.34784) 33 : cephadm [INF] Reconfiguring daemon osd.2 on smithi029 2023-07-20T15:10:01.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:01 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:01.016806+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:01.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:01 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:01.017751+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-20T15:10:01.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:01 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:01.018348+0000 mon.a (mon.0) 94 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:01.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:01 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:01.019668+0000 mon.a (mon.0) 95 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2023-07-20T15:10:01.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:01 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:00.051859+0000 mgr.y (mgr.34784) 31 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:01.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:01 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:00.096118+0000 mgr.y (mgr.34784) 32 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2023-07-20T15:10:01.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:01 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:00.097881+0000 mgr.y (mgr.34784) 33 : cephadm [INF] Reconfiguring daemon osd.2 on smithi029 2023-07-20T15:10:01.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:01 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:01.016806+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:01.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:01 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:01.017751+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-20T15:10:01.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:01 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:01.018348+0000 mon.a (mon.0) 94 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:01.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:01 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:01.019668+0000 mon.a (mon.0) 95 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2023-07-20T15:10:02.564 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:01.017470+0000 mgr.y (mgr.34784) 34 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2023-07-20T15:10:02.564 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:01.019341+0000 mgr.y (mgr.34784) 35 : cephadm [INF] Reconfiguring daemon osd.3 on smithi029 2023-07-20T15:10:02.565 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:01.912735+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:02.565 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:01.913922+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi029.fdztmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2023-07-20T15:10:02.565 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:01.914585+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi029.fdztmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2023-07-20T15:10:02.565 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:01.917332+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi029.fdztmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2023-07-20T15:10:02.565 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:01.921049+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:02.565 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:01.921647+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi029.fdztmk"}]: dispatch 2023-07-20T15:10:02.566 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:01.922140+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:02.566 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:01.922949+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi029.fdztmk","key": "container_image"}]: dispatch 2023-07-20T15:10:02.566 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:01.017470+0000 mgr.y (mgr.34784) 34 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2023-07-20T15:10:02.566 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:01.019341+0000 mgr.y (mgr.34784) 35 : cephadm [INF] Reconfiguring daemon osd.3 on smithi029 2023-07-20T15:10:02.566 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:01.912735+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:02.566 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:01.913922+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi029.fdztmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2023-07-20T15:10:02.567 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:01.914585+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi029.fdztmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2023-07-20T15:10:02.567 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:01.917332+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi029.fdztmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2023-07-20T15:10:02.567 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:01.921049+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:02.568 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:01.921647+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi029.fdztmk"}]: dispatch 2023-07-20T15:10:02.568 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:01.922140+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:02.568 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:02 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:01.922949+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi029.fdztmk","key": "container_image"}]: dispatch 2023-07-20T15:10:02.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:02 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:01.017470+0000 mgr.y (mgr.34784) 34 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2023-07-20T15:10:02.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:02 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:01.019341+0000 mgr.y (mgr.34784) 35 : cephadm [INF] Reconfiguring daemon osd.3 on smithi029 2023-07-20T15:10:02.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:02 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:01.912735+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:02.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:02 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:01.913922+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi029.fdztmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2023-07-20T15:10:02.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:02 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:01.914585+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi029.fdztmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2023-07-20T15:10:02.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:02 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:01.917332+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi029.fdztmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2023-07-20T15:10:02.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:02 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:01.921049+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:02.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:02 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:01.921647+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi029.fdztmk"}]: dispatch 2023-07-20T15:10:02.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:02 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:01.922140+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:02.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:02 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:01.922949+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi029.fdztmk","key": "container_image"}]: dispatch 2023-07-20T15:10:03.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:03 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:01.913662+0000 mgr.y (mgr.34784) 36 : cephadm [INF] Reconfiguring rgw.r.z.smithi029.fdztmk (monmap changed)... 2023-07-20T15:10:03.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:03 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:01.917831+0000 mgr.y (mgr.34784) 37 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi029.fdztmk 2023-07-20T15:10:03.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:03 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:01.922640+0000 mgr.y (mgr.34784) 38 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi029.fdztmk on smithi029 2023-07-20T15:10:03.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:03 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:02.052607+0000 mgr.y (mgr.34784) 39 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:03.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:03 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:02.753993+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:03.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:03 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:02.754997+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:10:03.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:03 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:02.755551+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:10:03.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:03 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:02.756093+0000 mon.a (mon.0) 107 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:03.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:03 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:02.756979+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2023-07-20T15:10:03.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:01.913662+0000 mgr.y (mgr.34784) 36 : cephadm [INF] Reconfiguring rgw.r.z.smithi029.fdztmk (monmap changed)... 2023-07-20T15:10:03.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:01.917831+0000 mgr.y (mgr.34784) 37 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi029.fdztmk 2023-07-20T15:10:03.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:01.922640+0000 mgr.y (mgr.34784) 38 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi029.fdztmk on smithi029 2023-07-20T15:10:03.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:02.052607+0000 mgr.y (mgr.34784) 39 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:03.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:02.753993+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:03.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:02.754997+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:10:03.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:02.755551+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:10:03.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:02.756093+0000 mon.a (mon.0) 107 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:03.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:02.756979+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2023-07-20T15:10:03.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:01.913662+0000 mgr.y (mgr.34784) 36 : cephadm [INF] Reconfiguring rgw.r.z.smithi029.fdztmk (monmap changed)... 2023-07-20T15:10:03.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:01.917831+0000 mgr.y (mgr.34784) 37 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi029.fdztmk 2023-07-20T15:10:03.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:01.922640+0000 mgr.y (mgr.34784) 38 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi029.fdztmk on smithi029 2023-07-20T15:10:03.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:02.052607+0000 mgr.y (mgr.34784) 39 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:03.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:02.753993+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:03.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:02.754997+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-20T15:10:03.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:02.755551+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-20T15:10:03.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:02.756093+0000 mon.a (mon.0) 107 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:03.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:03 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:02.756979+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2023-07-20T15:10:04.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:04 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:02.754704+0000 mgr.y (mgr.34784) 40 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2023-07-20T15:10:04.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:04 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:02.756589+0000 mgr.y (mgr.34784) 41 : cephadm [INF] Reconfiguring daemon mon.b on smithi178 2023-07-20T15:10:04.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:04 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:03.711817+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:04.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:04 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:03.713089+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:10:04.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:04 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:03.714008+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-20T15:10:04.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:04 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:03.714769+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:04.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:04 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:03.716080+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2023-07-20T15:10:04.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:04 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:02.754704+0000 mgr.y (mgr.34784) 40 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2023-07-20T15:10:04.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:04 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:02.756589+0000 mgr.y (mgr.34784) 41 : cephadm [INF] Reconfiguring daemon mon.b on smithi178 2023-07-20T15:10:04.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:04 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:03.711817+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:04.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:04 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:03.713089+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:10:04.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:04 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:03.714008+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-20T15:10:04.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:04 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:03.714769+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:04.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:04 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:03.716080+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2023-07-20T15:10:04.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:04 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:02.754704+0000 mgr.y (mgr.34784) 40 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2023-07-20T15:10:04.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:04 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:02.756589+0000 mgr.y (mgr.34784) 41 : cephadm [INF] Reconfiguring daemon mon.b on smithi178 2023-07-20T15:10:04.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:04 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:03.711817+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:04.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:04 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:03.713089+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-20T15:10:04.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:04 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:03.714008+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-20T15:10:04.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:04 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:03.714769+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:04.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:04 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:03.716080+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2023-07-20T15:10:05.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:05 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:03.712719+0000 mgr.y (mgr.34784) 42 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2023-07-20T15:10:05.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:05 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:03.715487+0000 mgr.y (mgr.34784) 43 : cephadm [INF] Reconfiguring daemon mgr.x on smithi178 2023-07-20T15:10:05.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:05 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:04.053030+0000 mgr.y (mgr.34784) 44 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:05.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:05 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:04.625484+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:05.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:05 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:04.626676+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-20T15:10:05.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:05 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:04.627375+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:05.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:05 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:04.629014+0000 mon.a (mon.0) 117 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2023-07-20T15:10:05.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:05 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:03.712719+0000 mgr.y (mgr.34784) 42 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2023-07-20T15:10:05.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:05 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:03.715487+0000 mgr.y (mgr.34784) 43 : cephadm [INF] Reconfiguring daemon mgr.x on smithi178 2023-07-20T15:10:05.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:05 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:04.053030+0000 mgr.y (mgr.34784) 44 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:05.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:05 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:04.625484+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:05.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:05 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:04.626676+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-20T15:10:05.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:05 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:04.627375+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:05.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:05 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:04.629014+0000 mon.a (mon.0) 117 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2023-07-20T15:10:05.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:05 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:03.712719+0000 mgr.y (mgr.34784) 42 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2023-07-20T15:10:05.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:05 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:03.715487+0000 mgr.y (mgr.34784) 43 : cephadm [INF] Reconfiguring daemon mgr.x on smithi178 2023-07-20T15:10:05.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:05 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:04.053030+0000 mgr.y (mgr.34784) 44 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:05.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:05 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:04.625484+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:05.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:05 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:04.626676+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-20T15:10:05.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:05 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:04.627375+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:05.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:05 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:04.629014+0000 mon.a (mon.0) 117 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2023-07-20T15:10:06.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:06 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:04.626371+0000 mgr.y (mgr.34784) 45 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2023-07-20T15:10:06.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:06 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:04.628592+0000 mgr.y (mgr.34784) 46 : cephadm [INF] Reconfiguring daemon osd.4 on smithi178 2023-07-20T15:10:06.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:06 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:05.608039+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:06.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:06 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:05.609275+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-20T15:10:06.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:06 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:05.610120+0000 mon.a (mon.0) 120 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:06.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:06 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:05.611896+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2023-07-20T15:10:06.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:06 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:04.626371+0000 mgr.y (mgr.34784) 45 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2023-07-20T15:10:06.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:06 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:04.628592+0000 mgr.y (mgr.34784) 46 : cephadm [INF] Reconfiguring daemon osd.4 on smithi178 2023-07-20T15:10:06.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:06 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:05.608039+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:06.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:06 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:05.609275+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-20T15:10:06.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:06 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:05.610120+0000 mon.a (mon.0) 120 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:06.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:06 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:05.611896+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2023-07-20T15:10:06.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:06 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:04.626371+0000 mgr.y (mgr.34784) 45 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2023-07-20T15:10:06.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:06 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:04.628592+0000 mgr.y (mgr.34784) 46 : cephadm [INF] Reconfiguring daemon osd.4 on smithi178 2023-07-20T15:10:06.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:06 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:05.608039+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:06.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:06 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:05.609275+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-20T15:10:06.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:06 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:05.610120+0000 mon.a (mon.0) 120 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:06.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:06 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:05.611896+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2023-07-20T15:10:07.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:07 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:05.608903+0000 mgr.y (mgr.34784) 47 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2023-07-20T15:10:07.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:07 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:05.611408+0000 mgr.y (mgr.34784) 48 : cephadm [INF] Reconfiguring daemon osd.5 on smithi178 2023-07-20T15:10:07.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:07 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:06.053413+0000 mgr.y (mgr.34784) 49 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:07.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:07 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:06.529181+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:07.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:07 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:06.530384+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-20T15:10:07.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:07 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:06.531207+0000 mon.a (mon.0) 124 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:07.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:07 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:06.532915+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2023-07-20T15:10:07.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:07 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:05.608903+0000 mgr.y (mgr.34784) 47 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2023-07-20T15:10:07.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:07 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:05.611408+0000 mgr.y (mgr.34784) 48 : cephadm [INF] Reconfiguring daemon osd.5 on smithi178 2023-07-20T15:10:07.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:07 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:06.053413+0000 mgr.y (mgr.34784) 49 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:07.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:07 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:06.529181+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:07.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:07 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:06.530384+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-20T15:10:07.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:07 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:06.531207+0000 mon.a (mon.0) 124 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:07.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:07 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:06.532915+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2023-07-20T15:10:07.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:07 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:05.608903+0000 mgr.y (mgr.34784) 47 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2023-07-20T15:10:07.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:07 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:05.611408+0000 mgr.y (mgr.34784) 48 : cephadm [INF] Reconfiguring daemon osd.5 on smithi178 2023-07-20T15:10:07.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:07 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:06.053413+0000 mgr.y (mgr.34784) 49 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:07.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:07 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:06.529181+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:07.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:07 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:06.530384+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-20T15:10:07.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:07 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:06.531207+0000 mon.a (mon.0) 124 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:07.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:07 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:06.532915+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2023-07-20T15:10:08.686 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:08 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:06.530041+0000 mgr.y (mgr.34784) 50 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2023-07-20T15:10:08.687 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:08 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:06.532495+0000 mgr.y (mgr.34784) 51 : cephadm [INF] Reconfiguring daemon osd.6 on smithi178 2023-07-20T15:10:08.687 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:08 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:07.432051+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:08.687 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:08 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:07.433223+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-20T15:10:08.687 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:08 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:07.434003+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:08.687 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:08 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:07.435773+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2023-07-20T15:10:08.688 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:08 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:08.306828+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:08.688 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:08 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:08.308529+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi178.bnfxtc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2023-07-20T15:10:08.688 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:08 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:08.309454+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi178.bnfxtc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2023-07-20T15:10:08.688 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:08 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:08.312523+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi178.bnfxtc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2023-07-20T15:10:08.688 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:08 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:08.316496+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:08.688 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:08 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:08.317281+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi178.bnfxtc"}]: dispatch 2023-07-20T15:10:08.688 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:08 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:08.317965+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:08.689 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:08 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:08.319062+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi178.bnfxtc","key": "container_image"}]: dispatch 2023-07-20T15:10:08.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:06.530041+0000 mgr.y (mgr.34784) 50 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2023-07-20T15:10:08.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:06.532495+0000 mgr.y (mgr.34784) 51 : cephadm [INF] Reconfiguring daemon osd.6 on smithi178 2023-07-20T15:10:08.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:07.432051+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:08.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:07.433223+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-20T15:10:08.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:07.434003+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:08.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:07.435773+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2023-07-20T15:10:08.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:08.306828+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:08.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:08.308529+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi178.bnfxtc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2023-07-20T15:10:08.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:08.309454+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi178.bnfxtc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2023-07-20T15:10:08.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:08.312523+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi178.bnfxtc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2023-07-20T15:10:08.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:08.316496+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:08.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:08.317281+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi178.bnfxtc"}]: dispatch 2023-07-20T15:10:08.705 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:08.317965+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:08.705 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:08.319062+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi178.bnfxtc","key": "container_image"}]: dispatch 2023-07-20T15:10:08.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:06.530041+0000 mgr.y (mgr.34784) 50 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2023-07-20T15:10:08.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:06.532495+0000 mgr.y (mgr.34784) 51 : cephadm [INF] Reconfiguring daemon osd.6 on smithi178 2023-07-20T15:10:08.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:07.432051+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:08.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:07.433223+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-20T15:10:08.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:07.434003+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:08.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:07.435773+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2023-07-20T15:10:08.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:08.306828+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:08.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:08.308529+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi178.bnfxtc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2023-07-20T15:10:08.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:08.309454+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi178.bnfxtc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2023-07-20T15:10:08.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:08.312523+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi178.bnfxtc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2023-07-20T15:10:08.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:08.316496+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:08.707 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:08.317281+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi178.bnfxtc"}]: dispatch 2023-07-20T15:10:08.707 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:08.317965+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:08.707 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:08 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:08.319062+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi178.bnfxtc","key": "container_image"}]: dispatch 2023-07-20T15:10:09.679 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:07.432891+0000 mgr.y (mgr.34784) 52 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2023-07-20T15:10:09.679 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:07.435298+0000 mgr.y (mgr.34784) 53 : cephadm [INF] Reconfiguring daemon osd.7 on smithi178 2023-07-20T15:10:09.679 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:08.054307+0000 mgr.y (mgr.34784) 54 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:09.680 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:08.308139+0000 mgr.y (mgr.34784) 55 : cephadm [INF] Reconfiguring rgw.r.z.smithi178.bnfxtc (monmap changed)... 2023-07-20T15:10:09.680 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:08.313116+0000 mgr.y (mgr.34784) 56 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi178.bnfxtc 2023-07-20T15:10:09.680 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:08.318619+0000 mgr.y (mgr.34784) 57 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi178.bnfxtc on smithi178 2023-07-20T15:10:09.680 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:09.208226+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:09.680 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:09.210085+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:10:09.680 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:09.212771+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:09.680 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:09.214444+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:09.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:09.219225+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:09.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:09.220131+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2023-07-20T15:10:09.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:09.223659+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2023-07-20T15:10:09.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:09.224445+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2023-07-20T15:10:09.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:09.227634+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2023-07-20T15:10:09.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:09.228396+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2023-07-20T15:10:09.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:09.231707+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2023-07-20T15:10:09.682 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:09.232843+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:09.682 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:09.237081+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:09.682 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:09.238407+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-07-20T15:10:09.682 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:07.432891+0000 mgr.y (mgr.34784) 52 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2023-07-20T15:10:09.682 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:07.435298+0000 mgr.y (mgr.34784) 53 : cephadm [INF] Reconfiguring daemon osd.7 on smithi178 2023-07-20T15:10:09.683 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:08.054307+0000 mgr.y (mgr.34784) 54 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:09.683 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:08.308139+0000 mgr.y (mgr.34784) 55 : cephadm [INF] Reconfiguring rgw.r.z.smithi178.bnfxtc (monmap changed)... 2023-07-20T15:10:09.683 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:08.313116+0000 mgr.y (mgr.34784) 56 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi178.bnfxtc 2023-07-20T15:10:09.683 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:08.318619+0000 mgr.y (mgr.34784) 57 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi178.bnfxtc on smithi178 2023-07-20T15:10:09.683 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:09.208226+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:09.683 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:09.210085+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:10:09.683 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:09.212771+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:09.684 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:09.214444+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:09.684 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:09.219225+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:09.684 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:09.220131+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2023-07-20T15:10:09.684 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:09.223659+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2023-07-20T15:10:09.684 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:09.224445+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2023-07-20T15:10:09.684 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:09.227634+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2023-07-20T15:10:09.684 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:09.228396+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2023-07-20T15:10:09.684 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:09.231707+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2023-07-20T15:10:09.685 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:09.232843+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:09.685 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:09.237081+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:09.685 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:09 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:09.238407+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-07-20T15:10:09.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:07.432891+0000 mgr.y (mgr.34784) 52 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2023-07-20T15:10:09.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:07.435298+0000 mgr.y (mgr.34784) 53 : cephadm [INF] Reconfiguring daemon osd.7 on smithi178 2023-07-20T15:10:09.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:08.054307+0000 mgr.y (mgr.34784) 54 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:09.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:08.308139+0000 mgr.y (mgr.34784) 55 : cephadm [INF] Reconfiguring rgw.r.z.smithi178.bnfxtc (monmap changed)... 2023-07-20T15:10:09.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:08.313116+0000 mgr.y (mgr.34784) 56 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi178.bnfxtc 2023-07-20T15:10:09.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:08.318619+0000 mgr.y (mgr.34784) 57 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi178.bnfxtc on smithi178 2023-07-20T15:10:09.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:09.208226+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:09.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:09.210085+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:10:09.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:09.212771+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:09.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:09.214444+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:09.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:09.219225+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:09.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:09.220131+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2023-07-20T15:10:09.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:09.223659+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2023-07-20T15:10:09.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:09.224445+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2023-07-20T15:10:09.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:09.227634+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2023-07-20T15:10:09.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:09.228396+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2023-07-20T15:10:09.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:09.231707+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2023-07-20T15:10:09.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:09.232843+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:09.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:09.237081+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:09.926 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:09 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:09.238407+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-07-20T15:10:10.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:10 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:09.215206+0000 mgr.y (mgr.34784) 58 : cephadm [INF] Upgrade: Setting container_image for all mon 2023-07-20T15:10:10.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:10 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:09.233587+0000 mgr.y (mgr.34784) 59 : cephadm [INF] Upgrade: Setting container_image for all crash 2023-07-20T15:10:10.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:10 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:09.238598+0000 mgr.y (mgr.34784) 60 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-07-20T15:10:10.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:10 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:09.239483+0000 mgr.y (mgr.34784) 61 : cephadm [INF] Upgrade: osd.0 is safe to restart 2023-07-20T15:10:10.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:10 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:10.197802+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:10.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:10 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:10.198512+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-20T15:10:10.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:10 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:10.199005+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:10.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:10 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:10.200335+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2023-07-20T15:10:10.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:10 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:09.215206+0000 mgr.y (mgr.34784) 58 : cephadm [INF] Upgrade: Setting container_image for all mon 2023-07-20T15:10:10.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:10 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:09.233587+0000 mgr.y (mgr.34784) 59 : cephadm [INF] Upgrade: Setting container_image for all crash 2023-07-20T15:10:10.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:10 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:09.238598+0000 mgr.y (mgr.34784) 60 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-07-20T15:10:10.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:10 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:09.239483+0000 mgr.y (mgr.34784) 61 : cephadm [INF] Upgrade: osd.0 is safe to restart 2023-07-20T15:10:10.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:10 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:10.197802+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:10.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:10 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:10.198512+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-20T15:10:10.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:10 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:10.199005+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:10.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:10 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:10.200335+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2023-07-20T15:10:10.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:10 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:09.215206+0000 mgr.y (mgr.34784) 58 : cephadm [INF] Upgrade: Setting container_image for all mon 2023-07-20T15:10:10.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:10 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:09.233587+0000 mgr.y (mgr.34784) 59 : cephadm [INF] Upgrade: Setting container_image for all crash 2023-07-20T15:10:10.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:10 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:09.238598+0000 mgr.y (mgr.34784) 60 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-07-20T15:10:10.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:10 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:09.239483+0000 mgr.y (mgr.34784) 61 : cephadm [INF] Upgrade: osd.0 is safe to restart 2023-07-20T15:10:10.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:10 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:10.197802+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:10.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:10 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:10.198512+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-20T15:10:10.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:10 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:10.199005+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:10.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:10 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:10.200335+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2023-07-20T15:10:11.541 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:11 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:10.054650+0000 mgr.y (mgr.34784) 62 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:11.541 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:11 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:10.193734+0000 mgr.y (mgr.34784) 63 : cephadm [INF] Upgrade: Updating osd.0 2023-07-20T15:10:11.541 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:11 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:10.199979+0000 mgr.y (mgr.34784) 64 : cephadm [INF] Deploying daemon osd.0 on smithi029 2023-07-20T15:10:11.541 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:11 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:10.054650+0000 mgr.y (mgr.34784) 62 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:11.542 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:11 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:10.193734+0000 mgr.y (mgr.34784) 63 : cephadm [INF] Upgrade: Updating osd.0 2023-07-20T15:10:11.542 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:11 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:10.199979+0000 mgr.y (mgr.34784) 64 : cephadm [INF] Deploying daemon osd.0 on smithi029 2023-07-20T15:10:11.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:11 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:10.054650+0000 mgr.y (mgr.34784) 62 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:11.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:11 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:10.193734+0000 mgr.y (mgr.34784) 63 : cephadm [INF] Upgrade: Updating osd.0 2023-07-20T15:10:11.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:11 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:10.199979+0000 mgr.y (mgr.34784) 64 : cephadm [INF] Deploying daemon osd.0 on smithi029 2023-07-20T15:10:12.134 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:12 smithi029 systemd[1]: Stopping Ceph osd.0 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:10:12.447 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.328715+0000 mon.a (mon.0) 156 : cluster [DBG] osd.0 reported immediately failed by osd.1 2023-07-20T15:10:12.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.328758+0000 mon.a (mon.0) 157 : cluster [INF] osd.0 failed (root=default,host=smithi029) (connection refused reported by osd.1) 2023-07-20T15:10:12.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.328987+0000 mon.a (mon.0) 158 : cluster [DBG] osd.0 reported immediately failed by osd.7 2023-07-20T15:10:12.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.329104+0000 mon.a (mon.0) 159 : cluster [DBG] osd.0 reported immediately failed by osd.4 2023-07-20T15:10:12.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.329148+0000 mon.a (mon.0) 160 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-07-20T15:10:12.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.329254+0000 mon.a (mon.0) 161 : cluster [DBG] osd.0 reported immediately failed by osd.1 2023-07-20T15:10:12.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.329335+0000 mon.a (mon.0) 162 : cluster [DBG] osd.0 reported immediately failed by osd.6 2023-07-20T15:10:12.448 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.329472+0000 mon.a (mon.0) 163 : cluster [DBG] osd.0 reported immediately failed by osd.7 2023-07-20T15:10:12.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.329514+0000 mon.a (mon.0) 164 : cluster [DBG] osd.0 reported immediately failed by osd.4 2023-07-20T15:10:12.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.329621+0000 mon.a (mon.0) 165 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-07-20T15:10:12.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.329691+0000 mon.a (mon.0) 166 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-07-20T15:10:12.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.329850+0000 mon.a (mon.0) 167 : cluster [DBG] osd.0 reported immediately failed by osd.6 2023-07-20T15:10:12.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.329987+0000 mon.a (mon.0) 168 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-07-20T15:10:12.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.330108+0000 mon.a (mon.0) 169 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-07-20T15:10:12.449 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.330296+0000 mon.a (mon.0) 170 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-07-20T15:10:12.450 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:12 smithi029 bash[112337]: debug 2023-07-20T15:10:12.084+0000 7fc6f10a3700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T15:10:12.450 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:12 smithi029 bash[112337]: debug 2023-07-20T15:10:12.084+0000 7fc6f10a3700 -1 osd.0 78 *** Got signal Terminated *** 2023-07-20T15:10:12.450 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:12 smithi029 bash[112337]: debug 2023-07-20T15:10:12.084+0000 7fc6f10a3700 -1 osd.0 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-20T15:10:12.450 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:12 smithi029 bash[135754]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.0 2023-07-20T15:10:12.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.328715+0000 mon.a (mon.0) 156 : cluster [DBG] osd.0 reported immediately failed by osd.1 2023-07-20T15:10:12.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.328758+0000 mon.a (mon.0) 157 : cluster [INF] osd.0 failed (root=default,host=smithi029) (connection refused reported by osd.1) 2023-07-20T15:10:12.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.328987+0000 mon.a (mon.0) 158 : cluster [DBG] osd.0 reported immediately failed by osd.7 2023-07-20T15:10:12.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.329104+0000 mon.a (mon.0) 159 : cluster [DBG] osd.0 reported immediately failed by osd.4 2023-07-20T15:10:12.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.329148+0000 mon.a (mon.0) 160 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-07-20T15:10:12.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.329254+0000 mon.a (mon.0) 161 : cluster [DBG] osd.0 reported immediately failed by osd.1 2023-07-20T15:10:12.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.329335+0000 mon.a (mon.0) 162 : cluster [DBG] osd.0 reported immediately failed by osd.6 2023-07-20T15:10:12.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.329472+0000 mon.a (mon.0) 163 : cluster [DBG] osd.0 reported immediately failed by osd.7 2023-07-20T15:10:12.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.329514+0000 mon.a (mon.0) 164 : cluster [DBG] osd.0 reported immediately failed by osd.4 2023-07-20T15:10:12.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.329621+0000 mon.a (mon.0) 165 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-07-20T15:10:12.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.329691+0000 mon.a (mon.0) 166 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-07-20T15:10:12.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.329850+0000 mon.a (mon.0) 167 : cluster [DBG] osd.0 reported immediately failed by osd.6 2023-07-20T15:10:12.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.329987+0000 mon.a (mon.0) 168 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-07-20T15:10:12.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.330108+0000 mon.a (mon.0) 169 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-07-20T15:10:12.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:12 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.330296+0000 mon.a (mon.0) 170 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-07-20T15:10:12.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:12 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.328715+0000 mon.a (mon.0) 156 : cluster [DBG] osd.0 reported immediately failed by osd.1 2023-07-20T15:10:12.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:12 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.328758+0000 mon.a (mon.0) 157 : cluster [INF] osd.0 failed (root=default,host=smithi029) (connection refused reported by osd.1) 2023-07-20T15:10:12.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:12 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.328987+0000 mon.a (mon.0) 158 : cluster [DBG] osd.0 reported immediately failed by osd.7 2023-07-20T15:10:12.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:12 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.329104+0000 mon.a (mon.0) 159 : cluster [DBG] osd.0 reported immediately failed by osd.4 2023-07-20T15:10:12.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:12 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.329148+0000 mon.a (mon.0) 160 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-07-20T15:10:12.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:12 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.329254+0000 mon.a (mon.0) 161 : cluster [DBG] osd.0 reported immediately failed by osd.1 2023-07-20T15:10:12.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:12 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.329335+0000 mon.a (mon.0) 162 : cluster [DBG] osd.0 reported immediately failed by osd.6 2023-07-20T15:10:12.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:12 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.329472+0000 mon.a (mon.0) 163 : cluster [DBG] osd.0 reported immediately failed by osd.7 2023-07-20T15:10:12.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:12 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.329514+0000 mon.a (mon.0) 164 : cluster [DBG] osd.0 reported immediately failed by osd.4 2023-07-20T15:10:12.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:12 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.329621+0000 mon.a (mon.0) 165 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-07-20T15:10:12.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:12 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.329691+0000 mon.a (mon.0) 166 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-07-20T15:10:12.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:12 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.329850+0000 mon.a (mon.0) 167 : cluster [DBG] osd.0 reported immediately failed by osd.6 2023-07-20T15:10:12.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:12 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.329987+0000 mon.a (mon.0) 168 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-07-20T15:10:12.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:12 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.330108+0000 mon.a (mon.0) 169 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-07-20T15:10:12.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:12 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.330296+0000 mon.a (mon.0) 170 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-07-20T15:10:13.440 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:10:13 smithi029 bash[129394]: ts=2023-07-20T15:10:13.249Z caller=notify.go:732 level=warn component=dispatcher receiver=web.hook integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"http://127.0.0.1:5001/\": dial tcp 127.0.0.1:5001: connect: connection refused" 2023-07-20T15:10:13.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:13 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.055534+0000 mgr.y (mgr.34784) 65 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:13.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:13 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.386127+0000 mon.a (mon.0) 171 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:10:13.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:13 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:12.393661+0000 mon.a (mon.0) 172 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2023-07-20T15:10:13.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:13 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:12.397361+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-07-20T15:10:13.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:13 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:12.402253+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-07-20T15:10:13.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:13 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.055534+0000 mgr.y (mgr.34784) 65 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:13.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:13 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.386127+0000 mon.a (mon.0) 171 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:10:13.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:13 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:12.393661+0000 mon.a (mon.0) 172 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2023-07-20T15:10:13.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:13 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:12.397361+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-07-20T15:10:13.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:13 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:12.402253+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-07-20T15:10:13.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:13 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.055534+0000 mgr.y (mgr.34784) 65 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:13.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:13 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.386127+0000 mon.a (mon.0) 171 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:10:13.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:13 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:12.393661+0000 mon.a (mon.0) 172 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2023-07-20T15:10:13.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:13 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:12.397361+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-07-20T15:10:13.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:13 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:12.402253+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-07-20T15:10:14.201 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:13 smithi029 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.0.service: Succeeded. 2023-07-20T15:10:14.202 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:13 smithi029 systemd[1]: Stopped Ceph osd.0 for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:10:14.202 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:13 smithi029 systemd[1]: Starting Ceph osd.0 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:10:14.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:14 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:13.396786+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-07-20T15:10:14.453 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:14 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:13.396880+0000 mon.a (mon.0) 176 : cluster [DBG] osdmap e80: 8 total, 7 up, 8 in 2023-07-20T15:10:14.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:14 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:13.396786+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-07-20T15:10:14.453 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:14 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:13.396880+0000 mon.a (mon.0) 176 : cluster [DBG] osdmap e80: 8 total, 7 up, 8 in 2023-07-20T15:10:14.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:14 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:13.396786+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-07-20T15:10:14.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:14 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:13.396880+0000 mon.a (mon.0) 176 : cluster [DBG] osdmap e80: 8 total, 7 up, 8 in 2023-07-20T15:10:14.953 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:14 smithi029 bash[136051]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-20T15:10:14.953 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:14 smithi029 bash[136051]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-07-20T15:10:14.954 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:14 smithi029 bash[136051]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-07-20T15:10:14.954 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:14 smithi029 bash[136051]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-07-20T15:10:14.954 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:14 smithi029 bash[136051]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2023-07-20T15:10:14.954 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:14 smithi029 bash[136051]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-20T15:10:14.954 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:14 smithi029 bash[136051]: --> ceph-volume raw activate successful for osd ID: 0 2023-07-20T15:10:15.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:15 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:14.055867+0000 mgr.y (mgr.34784) 66 : cluster [DBG] pgmap v24: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:15.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:15 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:14.055867+0000 mgr.y (mgr.34784) 66 : cluster [DBG] pgmap v24: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:15.704 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:15 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd-0[136350]: debug 2023-07-20T15:10:15.362+0000 7f6d33c96700 1 -- 172.21.15.29:0/3771810134 <== mon.0 v2:172.21.15.29:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559d679ec4e0 con 0x559d679b3400 2023-07-20T15:10:15.704 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:15 smithi029 bash[136335]: b8c65227a621277695407f8b6910ff9ebb36b856af7a829b96d62ccb49ab3284 2023-07-20T15:10:15.704 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:15 smithi029 systemd[1]: Started Ceph osd.0 for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:10:15.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:15 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:14.055867+0000 mgr.y (mgr.34784) 66 : cluster [DBG] pgmap v24: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:16.203 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:15 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd-0[136350]: debug 2023-07-20T15:10:15.885+0000 7f6d3b711200 -1 Falling back to public interface 2023-07-20T15:10:16.777 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:16 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:15.418142+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:16.777 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:16 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:15.418920+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:10:16.777 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:16 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:15.668633+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:16.778 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:16 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:15.669465+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:10:16.778 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:16 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:15.418142+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:16.778 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:16 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:15.418920+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:10:16.778 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:16 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:15.668633+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:16.778 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:16 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:15.669465+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:10:16.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:16 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:15.418142+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:16.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:16 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:15.418920+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:10:16.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:16 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:15.668633+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:16.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:16 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:15.669465+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:10:17.779 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:17 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:16.056385+0000 mgr.y (mgr.34784) 67 : cluster [DBG] pgmap v25: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:17.780 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:17 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:16.056385+0000 mgr.y (mgr.34784) 67 : cluster [DBG] pgmap v25: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:17.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:17 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:16.056385+0000 mgr.y (mgr.34784) 67 : cluster [DBG] pgmap v25: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 6.9 MiB used, 707 GiB / 715 GiB avail 2023-07-20T15:10:18.453 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:10:18.349+0000 7fd67e5c7700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2023-07-20T15:10:18.454 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd-0[136350]: debug 2023-07-20T15:10:18.123+0000 7f6d3b711200 -1 osd.0 78 log_to_monitors {default=true} 2023-07-20T15:10:18.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:18 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:18.127960+0000 mon.c (mon.1) 3 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/1057201017,v1:172.21.15.29:6803/1057201017]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-20T15:10:18.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:18 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:18.128267+0000 mon.a (mon.0) 181 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-20T15:10:18.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:18 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:18.337609+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:18.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:18 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:18.341163+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:18.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:18 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:18.345711+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:10:18.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:18 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:18.347637+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:18.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:18 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:18.348815+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:18.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:18 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:18.349687+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:18.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:18 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:18.350817+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-07-20T15:10:18.953 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd-0[136350]: debug 2023-07-20T15:10:18.436+0000 7f6d2c40a700 -1 osd.0 78 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-20T15:10:18.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:18.127960+0000 mon.c (mon.1) 3 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/1057201017,v1:172.21.15.29:6803/1057201017]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-20T15:10:18.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:18.128267+0000 mon.a (mon.0) 181 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-20T15:10:18.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:18.337609+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:18.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:18.341163+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:18.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:18.345711+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:10:18.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:18.347637+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:18.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:18.348815+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:18.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:18.349687+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:18.955 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:18.350817+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-07-20T15:10:18.955 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:18.127960+0000 mon.c (mon.1) 3 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/1057201017,v1:172.21.15.29:6803/1057201017]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-20T15:10:18.955 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:18.128267+0000 mon.a (mon.0) 181 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-20T15:10:18.955 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:18.337609+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:18.955 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:18.341163+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:18.955 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:18.345711+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:10:18.956 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:18.347637+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:18.956 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:18.348815+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:18.956 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:18.349687+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:18.956 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:18 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:18.350817+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-07-20T15:10:19.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:19 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:18.057169+0000 mgr.y (mgr.34784) 68 : cluster [DBG] pgmap v26: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 7.0 MiB used, 707 GiB / 715 GiB avail; 68/606 objects degraded (11.221%) 2023-07-20T15:10:19.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:19 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:18.350944+0000 mgr.y (mgr.34784) 69 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-07-20T15:10:19.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:19 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:18.351632+0000 mgr.y (mgr.34784) 70 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2023-07-20T15:10:19.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:19 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:18.419721+0000 mon.a (mon.0) 189 : cluster [WRN] Health check failed: Degraded data redundancy: 68/606 objects degraded (11.221%), 20 pgs degraded (PG_DEGRADED) 2023-07-20T15:10:19.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:19 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:18.426733+0000 mon.a (mon.0) 190 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-07-20T15:10:19.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:19 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:18.426780+0000 mon.a (mon.0) 191 : cluster [DBG] osdmap e81: 8 total, 7 up, 8 in 2023-07-20T15:10:19.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:19 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:18.427840+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/1057201017,v1:172.21.15.29:6803/1057201017]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:10:19.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:19 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:18.428234+0000 mon.a (mon.0) 192 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:10:19.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:19 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:18.057169+0000 mgr.y (mgr.34784) 68 : cluster [DBG] pgmap v26: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 7.0 MiB used, 707 GiB / 715 GiB avail; 68/606 objects degraded (11.221%) 2023-07-20T15:10:19.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:19 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:18.350944+0000 mgr.y (mgr.34784) 69 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-07-20T15:10:19.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:19 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:18.351632+0000 mgr.y (mgr.34784) 70 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2023-07-20T15:10:19.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:19 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:18.419721+0000 mon.a (mon.0) 189 : cluster [WRN] Health check failed: Degraded data redundancy: 68/606 objects degraded (11.221%), 20 pgs degraded (PG_DEGRADED) 2023-07-20T15:10:19.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:19 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:18.426733+0000 mon.a (mon.0) 190 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-07-20T15:10:19.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:19 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:18.426780+0000 mon.a (mon.0) 191 : cluster [DBG] osdmap e81: 8 total, 7 up, 8 in 2023-07-20T15:10:19.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:19 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:18.427840+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/1057201017,v1:172.21.15.29:6803/1057201017]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:10:19.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:19 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:18.428234+0000 mon.a (mon.0) 192 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:10:19.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:19 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:18.057169+0000 mgr.y (mgr.34784) 68 : cluster [DBG] pgmap v26: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 7.0 MiB used, 707 GiB / 715 GiB avail; 68/606 objects degraded (11.221%) 2023-07-20T15:10:19.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:19 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:18.350944+0000 mgr.y (mgr.34784) 69 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-07-20T15:10:19.955 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:19 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:18.351632+0000 mgr.y (mgr.34784) 70 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2023-07-20T15:10:19.955 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:19 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:18.419721+0000 mon.a (mon.0) 189 : cluster [WRN] Health check failed: Degraded data redundancy: 68/606 objects degraded (11.221%), 20 pgs degraded (PG_DEGRADED) 2023-07-20T15:10:19.955 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:19 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:18.426733+0000 mon.a (mon.0) 190 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-07-20T15:10:19.955 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:19 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:18.426780+0000 mon.a (mon.0) 191 : cluster [DBG] osdmap e81: 8 total, 7 up, 8 in 2023-07-20T15:10:19.955 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:19 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:18.427840+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.15.29:6802/1057201017,v1:172.21.15.29:6803/1057201017]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:10:19.955 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:19 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:18.428234+0000 mon.a (mon.0) 192 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:10:20.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:20 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:19.426610+0000 mon.a (mon.0) 193 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:10:20.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:20 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:19.430233+0000 mon.a (mon.0) 194 : cluster [INF] osd.0 [v2:172.21.15.29:6802/1057201017,v1:172.21.15.29:6803/1057201017] boot 2023-07-20T15:10:20.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:20 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:19.430299+0000 mon.a (mon.0) 195 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2023-07-20T15:10:20.924 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:20 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:19.430521+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:10:20.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:20 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:19.426610+0000 mon.a (mon.0) 193 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:10:20.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:20 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:19.430233+0000 mon.a (mon.0) 194 : cluster [INF] osd.0 [v2:172.21.15.29:6802/1057201017,v1:172.21.15.29:6803/1057201017] boot 2023-07-20T15:10:20.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:20 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:19.430299+0000 mon.a (mon.0) 195 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2023-07-20T15:10:20.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:20 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:19.430521+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:10:20.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:20 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:19.426610+0000 mon.a (mon.0) 193 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:10:20.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:20 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:19.430233+0000 mon.a (mon.0) 194 : cluster [INF] osd.0 [v2:172.21.15.29:6802/1057201017,v1:172.21.15.29:6803/1057201017] boot 2023-07-20T15:10:20.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:20 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:19.430299+0000 mon.a (mon.0) 195 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2023-07-20T15:10:20.954 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:20 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:19.430521+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-20T15:10:21.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:21 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:20.057684+0000 mgr.y (mgr.34784) 71 : cluster [DBG] pgmap v29: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail; 68/606 objects degraded (11.221%) 2023-07-20T15:10:21.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:21 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:20.434810+0000 mon.a (mon.0) 197 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2023-07-20T15:10:21.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:20.057684+0000 mgr.y (mgr.34784) 71 : cluster [DBG] pgmap v29: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail; 68/606 objects degraded (11.221%) 2023-07-20T15:10:21.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:20.434810+0000 mon.a (mon.0) 197 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2023-07-20T15:10:21.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:20.057684+0000 mgr.y (mgr.34784) 71 : cluster [DBG] pgmap v29: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail; 68/606 objects degraded (11.221%) 2023-07-20T15:10:21.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:21 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:20.434810+0000 mon.a (mon.0) 197 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2023-07-20T15:10:23.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:23 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:22.058602+0000 mgr.y (mgr.34784) 72 : cluster [DBG] pgmap v31: 129 pgs: 8 active+undersized+degraded, 8 active+undersized, 113 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail; 30/606 objects degraded (4.950%) 2023-07-20T15:10:23.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:23 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:22.058602+0000 mgr.y (mgr.34784) 72 : cluster [DBG] pgmap v31: 129 pgs: 8 active+undersized+degraded, 8 active+undersized, 113 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail; 30/606 objects degraded (4.950%) 2023-07-20T15:10:23.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:23 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:22.058602+0000 mgr.y (mgr.34784) 72 : cluster [DBG] pgmap v31: 129 pgs: 8 active+undersized+degraded, 8 active+undersized, 113 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail; 30/606 objects degraded (4.950%) 2023-07-20T15:10:24.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:24 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:24.059264+0000 mgr.y (mgr.34784) 73 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:24.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:24.059264+0000 mgr.y (mgr.34784) 73 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:24.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:24 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:24.059264+0000 mgr.y (mgr.34784) 73 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:25.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:25 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:24.429226+0000 mon.a (mon.0) 198 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/606 objects degraded (4.950%), 8 pgs degraded) 2023-07-20T15:10:25.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:25 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:24.429260+0000 mon.a (mon.0) 199 : cluster [INF] Cluster is now healthy 2023-07-20T15:10:25.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:25 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:24.429226+0000 mon.a (mon.0) 198 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/606 objects degraded (4.950%), 8 pgs degraded) 2023-07-20T15:10:25.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:25 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:24.429260+0000 mon.a (mon.0) 199 : cluster [INF] Cluster is now healthy 2023-07-20T15:10:25.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:25 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:24.429226+0000 mon.a (mon.0) 198 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/606 objects degraded (4.950%), 8 pgs degraded) 2023-07-20T15:10:25.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:25 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:24.429260+0000 mon.a (mon.0) 199 : cluster [INF] Cluster is now healthy 2023-07-20T15:10:27.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:27 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:26.059889+0000 mgr.y (mgr.34784) 74 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:27.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:27 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:26.059889+0000 mgr.y (mgr.34784) 74 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:27.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:27 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:26.059889+0000 mgr.y (mgr.34784) 74 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:29.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:29 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:28.060654+0000 mgr.y (mgr.34784) 75 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:29.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:29 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:28.060654+0000 mgr.y (mgr.34784) 75 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:29.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:29 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:28.060654+0000 mgr.y (mgr.34784) 75 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:31.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:31 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:30.061167+0000 mgr.y (mgr.34784) 76 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:31.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:31 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:31.262383+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:31.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:31 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:30.061167+0000 mgr.y (mgr.34784) 76 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:31.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:31 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:31.262383+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:31.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:31 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:30.061167+0000 mgr.y (mgr.34784) 76 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:31.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:31 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:31.262383+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:33.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:33 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:32.062034+0000 mgr.y (mgr.34784) 77 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:33.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:33 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:32.062034+0000 mgr.y (mgr.34784) 77 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:33.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:33 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:32.062034+0000 mgr.y (mgr.34784) 77 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:34.414 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:34 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:33.358090+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-07-20T15:10:34.414 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:34 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:33.358325+0000 mgr.y (mgr.34784) 78 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-07-20T15:10:34.415 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:34 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:33.359633+0000 mgr.y (mgr.34784) 79 : cephadm [INF] Upgrade: osd.1 is safe to restart 2023-07-20T15:10:34.415 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:34 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:33.358090+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-07-20T15:10:34.415 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:34 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:33.358325+0000 mgr.y (mgr.34784) 78 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-07-20T15:10:34.415 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:34 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:33.359633+0000 mgr.y (mgr.34784) 79 : cephadm [INF] Upgrade: osd.1 is safe to restart 2023-07-20T15:10:34.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:34 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:33.358090+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-07-20T15:10:34.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:34 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:33.358325+0000 mgr.y (mgr.34784) 78 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-07-20T15:10:34.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:34 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:33.359633+0000 mgr.y (mgr.34784) 79 : cephadm [INF] Upgrade: osd.1 is safe to restart 2023-07-20T15:10:34.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:34 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:34.270370+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:34.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:34 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:34.271409+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-20T15:10:34.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:34 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:34.271999+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:34.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:34 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:34.273395+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2023-07-20T15:10:34.679 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:34 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:34.270370+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:34.679 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:34 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:34.271409+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-20T15:10:34.679 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:34 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:34.271999+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:34.679 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:34 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:34.273395+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2023-07-20T15:10:34.680 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:34 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:34.270370+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:34.680 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:34 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:34.271409+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-20T15:10:34.680 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:34 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:34.271999+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-20T15:10:34.680 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:34 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:34.273395+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2023-07-20T15:10:35.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:35 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:34.062567+0000 mgr.y (mgr.34784) 80 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:35.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:35 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:34.266165+0000 mgr.y (mgr.34784) 81 : cephadm [INF] Upgrade: Updating osd.1 2023-07-20T15:10:35.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:35 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:34.273046+0000 mgr.y (mgr.34784) 82 : cephadm [INF] Deploying daemon osd.1 on smithi029 2023-07-20T15:10:35.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:35 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:34.062567+0000 mgr.y (mgr.34784) 80 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:35.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:35 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:34.266165+0000 mgr.y (mgr.34784) 81 : cephadm [INF] Upgrade: Updating osd.1 2023-07-20T15:10:35.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:35 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:34.273046+0000 mgr.y (mgr.34784) 82 : cephadm [INF] Deploying daemon osd.1 on smithi029 2023-07-20T15:10:35.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:35 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:34.062567+0000 mgr.y (mgr.34784) 80 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:35.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:35 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:34.266165+0000 mgr.y (mgr.34784) 81 : cephadm [INF] Upgrade: Updating osd.1 2023-07-20T15:10:35.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:35 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:34.273046+0000 mgr.y (mgr.34784) 82 : cephadm [INF] Deploying daemon osd.1 on smithi029 2023-07-20T15:10:36.359 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:36 smithi029 systemd[1]: Stopping Ceph osd.1 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:10:36.359 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:36 smithi029 bash[114563]: debug 2023-07-20T15:10:36.117+0000 7f3fd03e1700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T15:10:36.359 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:36 smithi029 bash[114563]: debug 2023-07-20T15:10:36.117+0000 7f3fd03e1700 -1 osd.1 83 *** Got signal Terminated *** 2023-07-20T15:10:36.359 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:36 smithi029 bash[114563]: debug 2023-07-20T15:10:36.117+0000 7f3fd03e1700 -1 osd.1 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-20T15:10:36.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:36.077584+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2023-07-20T15:10:36.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:36.077799+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2023-07-20T15:10:36.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:36.078013+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2023-07-20T15:10:36.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:36.078215+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2023-07-20T15:10:36.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.363349+0000 mon.a (mon.0) 210 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:36.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.363393+0000 mon.a (mon.0) 211 : cluster [INF] osd.1 failed (root=default,host=smithi029) (connection refused reported by osd.7) 2023-07-20T15:10:36.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.363485+0000 mon.a (mon.0) 212 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:36.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.363693+0000 mon.a (mon.0) 213 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:36.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.363774+0000 mon.a (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:36.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.364043+0000 mon.a (mon.0) 215 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:36.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.364197+0000 mon.a (mon.0) 216 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:36.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.364410+0000 mon.a (mon.0) 217 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:36.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.364533+0000 mon.a (mon.0) 218 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:36.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.364647+0000 mon.a (mon.0) 219 : cluster [DBG] osd.1 reported immediately failed by osd.6 2023-07-20T15:10:36.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.364763+0000 mon.a (mon.0) 220 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:36.676 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.364887+0000 mon.a (mon.0) 221 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-07-20T15:10:36.676 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.364980+0000 mon.a (mon.0) 222 : cluster [DBG] osd.1 reported immediately failed by osd.6 2023-07-20T15:10:36.676 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.365081+0000 mon.a (mon.0) 223 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:36.676 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:36 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.365205+0000 mon.a (mon.0) 224 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-07-20T15:10:36.676 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:36 smithi029 bash[137412]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.1 2023-07-20T15:10:36.677 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:36 smithi029 bash[137467]: Error: no container with name or ID "ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.1" found: no such container 2023-07-20T15:10:36.677 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:36.077584+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2023-07-20T15:10:36.677 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:36.077799+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2023-07-20T15:10:36.677 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:36.078013+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2023-07-20T15:10:36.677 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:36.078215+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2023-07-20T15:10:36.678 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.363349+0000 mon.a (mon.0) 210 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:36.678 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.363393+0000 mon.a (mon.0) 211 : cluster [INF] osd.1 failed (root=default,host=smithi029) (connection refused reported by osd.7) 2023-07-20T15:10:36.678 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.363485+0000 mon.a (mon.0) 212 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:36.678 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.363693+0000 mon.a (mon.0) 213 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:36.678 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.363774+0000 mon.a (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:36.678 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.364043+0000 mon.a (mon.0) 215 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:36.678 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.364197+0000 mon.a (mon.0) 216 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:36.678 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.364410+0000 mon.a (mon.0) 217 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:36.679 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.364533+0000 mon.a (mon.0) 218 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:36.679 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.364647+0000 mon.a (mon.0) 219 : cluster [DBG] osd.1 reported immediately failed by osd.6 2023-07-20T15:10:36.679 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.364763+0000 mon.a (mon.0) 220 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:36.679 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.364887+0000 mon.a (mon.0) 221 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-07-20T15:10:36.679 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.364980+0000 mon.a (mon.0) 222 : cluster [DBG] osd.1 reported immediately failed by osd.6 2023-07-20T15:10:36.679 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.365081+0000 mon.a (mon.0) 223 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:36.679 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.365205+0000 mon.a (mon.0) 224 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-07-20T15:10:36.680 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:36.077584+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2023-07-20T15:10:36.680 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:36.077799+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2023-07-20T15:10:36.680 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:36.078013+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2023-07-20T15:10:36.680 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:36.078215+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2023-07-20T15:10:36.680 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.363349+0000 mon.a (mon.0) 210 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:36.680 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.363393+0000 mon.a (mon.0) 211 : cluster [INF] osd.1 failed (root=default,host=smithi029) (connection refused reported by osd.7) 2023-07-20T15:10:36.680 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.363485+0000 mon.a (mon.0) 212 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:36.681 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.363693+0000 mon.a (mon.0) 213 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:36.681 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.363774+0000 mon.a (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:36.681 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.364043+0000 mon.a (mon.0) 215 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:36.681 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.364197+0000 mon.a (mon.0) 216 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:36.681 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.364410+0000 mon.a (mon.0) 217 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:36.681 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.364533+0000 mon.a (mon.0) 218 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:36.681 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.364647+0000 mon.a (mon.0) 219 : cluster [DBG] osd.1 reported immediately failed by osd.6 2023-07-20T15:10:36.681 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.364763+0000 mon.a (mon.0) 220 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:36.682 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.364887+0000 mon.a (mon.0) 221 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-07-20T15:10:36.682 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.364980+0000 mon.a (mon.0) 222 : cluster [DBG] osd.1 reported immediately failed by osd.6 2023-07-20T15:10:36.682 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.365081+0000 mon.a (mon.0) 223 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:36.682 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:36 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.365205+0000 mon.a (mon.0) 224 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-07-20T15:10:37.424 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.062899+0000 mgr.y (mgr.34784) 83 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:37.424 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.425551+0000 mon.a (mon.0) 225 : cluster [DBG] osd.1 reported immediately failed by osd.6 2023-07-20T15:10:37.424 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.430412+0000 mon.a (mon.0) 226 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:37.424 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.430772+0000 mon.a (mon.0) 227 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:37.424 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.431953+0000 mon.a (mon.0) 228 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:37.424 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.449445+0000 mon.a (mon.0) 229 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:37.425 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.460318+0000 mon.a (mon.0) 230 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-07-20T15:10:37.425 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.631024+0000 mon.a (mon.0) 231 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:37.425 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.631710+0000 mon.a (mon.0) 232 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:37.425 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.632642+0000 mon.a (mon.0) 233 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:37.425 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.650642+0000 mon.a (mon.0) 234 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:37.425 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.732146+0000 mon.a (mon.0) 235 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:37.425 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.764876+0000 mon.a (mon.0) 236 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:37.425 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.765045+0000 mon.a (mon.0) 237 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:37.426 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.765124+0000 mon.a (mon.0) 238 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:37.426 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.765331+0000 mon.a (mon.0) 239 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:37.426 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.765456+0000 mon.a (mon.0) 240 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:37.426 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.765597+0000 mon.a (mon.0) 241 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:37.426 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.765641+0000 mon.a (mon.0) 242 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:37.426 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.765785+0000 mon.a (mon.0) 243 : cluster [DBG] osd.1 reported immediately failed by osd.6 2023-07-20T15:10:37.426 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.765917+0000 mon.a (mon.0) 244 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:37.427 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.766011+0000 mon.a (mon.0) 245 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-07-20T15:10:37.427 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.766166+0000 mon.a (mon.0) 246 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:37.427 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.766319+0000 mon.a (mon.0) 247 : cluster [DBG] osd.1 reported immediately failed by osd.6 2023-07-20T15:10:37.427 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.766444+0000 mon.a (mon.0) 248 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:37.427 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.766574+0000 mon.a (mon.0) 249 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-07-20T15:10:37.427 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:36.932236+0000 mon.a (mon.0) 250 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:37.427 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:37.031491+0000 mon.a (mon.0) 251 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:37.427 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:37.032658+0000 mon.a (mon.0) 252 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:37.428 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:37.033859+0000 mon.a (mon.0) 253 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:37.428 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:37.051564+0000 mon.a (mon.0) 254 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:37.428 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:37.333849+0000 mon.a (mon.0) 255 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:37.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.062899+0000 mgr.y (mgr.34784) 83 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:37.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.425551+0000 mon.a (mon.0) 225 : cluster [DBG] osd.1 reported immediately failed by osd.6 2023-07-20T15:10:37.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.430412+0000 mon.a (mon.0) 226 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:37.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.430772+0000 mon.a (mon.0) 227 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:37.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.431953+0000 mon.a (mon.0) 228 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:37.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.449445+0000 mon.a (mon.0) 229 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:37.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.460318+0000 mon.a (mon.0) 230 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-07-20T15:10:37.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.631024+0000 mon.a (mon.0) 231 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:37.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.631710+0000 mon.a (mon.0) 232 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:37.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.632642+0000 mon.a (mon.0) 233 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:37.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.650642+0000 mon.a (mon.0) 234 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:37.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.732146+0000 mon.a (mon.0) 235 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:37.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.764876+0000 mon.a (mon.0) 236 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:37.676 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.765045+0000 mon.a (mon.0) 237 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:37.676 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.765124+0000 mon.a (mon.0) 238 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:37.676 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.765331+0000 mon.a (mon.0) 239 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:37.676 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.765456+0000 mon.a (mon.0) 240 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:37.676 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.765597+0000 mon.a (mon.0) 241 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:37.676 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.765641+0000 mon.a (mon.0) 242 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:37.676 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.765785+0000 mon.a (mon.0) 243 : cluster [DBG] osd.1 reported immediately failed by osd.6 2023-07-20T15:10:37.677 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.765917+0000 mon.a (mon.0) 244 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:37.677 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.766011+0000 mon.a (mon.0) 245 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-07-20T15:10:37.677 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.766166+0000 mon.a (mon.0) 246 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:37.677 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.766319+0000 mon.a (mon.0) 247 : cluster [DBG] osd.1 reported immediately failed by osd.6 2023-07-20T15:10:37.677 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.766444+0000 mon.a (mon.0) 248 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:37.677 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.766574+0000 mon.a (mon.0) 249 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-07-20T15:10:37.677 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:36.932236+0000 mon.a (mon.0) 250 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:37.677 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:37.031491+0000 mon.a (mon.0) 251 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:37.678 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:37.032658+0000 mon.a (mon.0) 252 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:37.678 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:37.033859+0000 mon.a (mon.0) 253 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:37.678 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:37.051564+0000 mon.a (mon.0) 254 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:37.678 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:37.333849+0000 mon.a (mon.0) 255 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:37.678 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:37.352090+0000 mon.a (mon.0) 256 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:10:37.678 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:37 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:37.356045+0000 mon.a (mon.0) 257 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2023-07-20T15:10:37.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:37.352090+0000 mon.a (mon.0) 256 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:10:37.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:37.356045+0000 mon.a (mon.0) 257 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2023-07-20T15:10:37.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.062899+0000 mgr.y (mgr.34784) 83 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:37.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.425551+0000 mon.a (mon.0) 225 : cluster [DBG] osd.1 reported immediately failed by osd.6 2023-07-20T15:10:37.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.430412+0000 mon.a (mon.0) 226 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:37.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.430772+0000 mon.a (mon.0) 227 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:37.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.431953+0000 mon.a (mon.0) 228 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:37.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.449445+0000 mon.a (mon.0) 229 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:37.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.460318+0000 mon.a (mon.0) 230 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-07-20T15:10:37.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.631024+0000 mon.a (mon.0) 231 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:37.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.631710+0000 mon.a (mon.0) 232 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:37.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.632642+0000 mon.a (mon.0) 233 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:37.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.650642+0000 mon.a (mon.0) 234 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:37.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.732146+0000 mon.a (mon.0) 235 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:37.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.764876+0000 mon.a (mon.0) 236 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:37.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.765045+0000 mon.a (mon.0) 237 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:37.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.765124+0000 mon.a (mon.0) 238 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:37.705 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.765331+0000 mon.a (mon.0) 239 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:37.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.765456+0000 mon.a (mon.0) 240 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:37.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.765597+0000 mon.a (mon.0) 241 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:37.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.765641+0000 mon.a (mon.0) 242 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:37.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.765785+0000 mon.a (mon.0) 243 : cluster [DBG] osd.1 reported immediately failed by osd.6 2023-07-20T15:10:37.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.765917+0000 mon.a (mon.0) 244 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:37.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.766011+0000 mon.a (mon.0) 245 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-07-20T15:10:37.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.766166+0000 mon.a (mon.0) 246 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:37.706 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.766319+0000 mon.a (mon.0) 247 : cluster [DBG] osd.1 reported immediately failed by osd.6 2023-07-20T15:10:37.707 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.766444+0000 mon.a (mon.0) 248 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:37.707 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.766574+0000 mon.a (mon.0) 249 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-07-20T15:10:37.707 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:36.932236+0000 mon.a (mon.0) 250 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:37.707 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:37.031491+0000 mon.a (mon.0) 251 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-07-20T15:10:37.707 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:37.032658+0000 mon.a (mon.0) 252 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-07-20T15:10:37.707 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:37.033859+0000 mon.a (mon.0) 253 : cluster [DBG] osd.1 reported immediately failed by osd.7 2023-07-20T15:10:37.707 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:37.051564+0000 mon.a (mon.0) 254 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-07-20T15:10:37.708 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:37.333849+0000 mon.a (mon.0) 255 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-07-20T15:10:37.708 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:37.352090+0000 mon.a (mon.0) 256 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-07-20T15:10:37.708 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:37 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:37.356045+0000 mon.a (mon.0) 257 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2023-07-20T15:10:38.167 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:37 smithi029 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.1.service: Succeeded. 2023-07-20T15:10:38.168 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:37 smithi029 systemd[1]: Stopped Ceph osd.1 for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:10:38.168 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:37 smithi029 systemd[1]: Starting Ceph osd.1 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:10:38.953 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:38 smithi029 bash[137722]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-20T15:10:38.953 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:38 smithi029 bash[137722]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-07-20T15:10:38.953 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:38 smithi029 bash[137722]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-07-20T15:10:38.953 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:38 smithi029 bash[137722]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-07-20T15:10:38.954 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:38 smithi029 bash[137722]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2023-07-20T15:10:38.954 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:38 smithi029 bash[137722]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-20T15:10:38.954 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:38 smithi029 bash[137722]: --> ceph-volume raw activate successful for osd ID: 1 2023-07-20T15:10:39.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:39 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:38.063528+0000 mgr.y (mgr.34784) 84 : cluster [DBG] pgmap v40: 129 pgs: 18 stale+active+clean, 111 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:39.673 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:39 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:38.357468+0000 mon.a (mon.0) 258 : cluster [DBG] osdmap e85: 8 total, 7 up, 8 in 2023-07-20T15:10:39.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:39 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:39.338053+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:39.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:39 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:39.338796+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:10:39.674 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:39 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:39.340059+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:10:39.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:39 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:38.063528+0000 mgr.y (mgr.34784) 84 : cluster [DBG] pgmap v40: 129 pgs: 18 stale+active+clean, 111 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:39.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:39 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:38.357468+0000 mon.a (mon.0) 258 : cluster [DBG] osdmap e85: 8 total, 7 up, 8 in 2023-07-20T15:10:39.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:39 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:39.338053+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:39.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:39 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:39.338796+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:10:39.704 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:39 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:39.340059+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:10:39.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:39 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:38.063528+0000 mgr.y (mgr.34784) 84 : cluster [DBG] pgmap v40: 129 pgs: 18 stale+active+clean, 111 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail 2023-07-20T15:10:39.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:39 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:38.357468+0000 mon.a (mon.0) 258 : cluster [DBG] osdmap e85: 8 total, 7 up, 8 in 2023-07-20T15:10:39.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:39 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:39.338053+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:39.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:39 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:39.338796+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:10:39.704 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:39 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:39.340059+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2023-07-20T15:10:39.705 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:39 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd-1[138019]: debug 2023-07-20T15:10:39.282+0000 7f2a5bdca700 1 -- 172.21.15.29:0/4248315479 <== mon.1 v2:172.21.15.29:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f54f43a4e0 con 0x55f54f401800 2023-07-20T15:10:39.705 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:39 smithi029 bash[138004]: cd7f4b7e33b310ed4220ffe07be27d31ef632f612fc2a605f6649ab9a97b8735 2023-07-20T15:10:39.705 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:39 smithi029 systemd[1]: Started Ceph osd.1 for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:10:40.203 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:39 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd-1[138019]: debug 2023-07-20T15:10:39.811+0000 7f2a63845200 -1 Falling back to public interface 2023-07-20T15:10:40.703 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:40 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:40.355774+0000 mon.a (mon.0) 262 : cluster [WRN] Health check failed: Degraded data redundancy: 6/606 objects degraded (0.990%), 1 pg degraded (PG_DEGRADED) 2023-07-20T15:10:40.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:40 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:40.355774+0000 mon.a (mon.0) 262 : cluster [WRN] Health check failed: Degraded data redundancy: 6/606 objects degraded (0.990%), 1 pg degraded (PG_DEGRADED) 2023-07-20T15:10:40.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:40 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:40.355774+0000 mon.a (mon.0) 262 : cluster [WRN] Health check failed: Degraded data redundancy: 6/606 objects degraded (0.990%), 1 pg degraded (PG_DEGRADED) 2023-07-20T15:10:41.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:41 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:40.063978+0000 mgr.y (mgr.34784) 85 : cluster [DBG] pgmap v42: 129 pgs: 1 active+undersized+degraded, 17 stale+active+clean, 4 active+undersized, 107 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail; 6/606 objects degraded (0.990%) 2023-07-20T15:10:41.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:41 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:40.063978+0000 mgr.y (mgr.34784) 85 : cluster [DBG] pgmap v42: 129 pgs: 1 active+undersized+degraded, 17 stale+active+clean, 4 active+undersized, 107 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail; 6/606 objects degraded (0.990%) 2023-07-20T15:10:41.953 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:41 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:40.063978+0000 mgr.y (mgr.34784) 85 : cluster [DBG] pgmap v42: 129 pgs: 1 active+undersized+degraded, 17 stale+active+clean, 4 active+undersized, 107 active+clean; 7.0 KiB data, 12 MiB used, 708 GiB / 715 GiB avail; 6/606 objects degraded (0.990%) 2023-07-20T15:10:42.453 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:10:42.086+0000 7fd67e5c7700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2023-07-20T15:10:42.836 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd-1[138019]: debug 2023-07-20T15:10:42.537+0000 7f2a63845200 -1 osd.1 83 log_to_monitors {default=true} 2023-07-20T15:10:43.150 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:41.785161+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:43.150 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:42.064631+0000 mgr.y (mgr.34784) 86 : cluster [DBG] pgmap v43: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 13 MiB used, 708 GiB / 715 GiB avail; 82/606 objects degraded (13.531%) 2023-07-20T15:10:43.151 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:42.076511+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:43.151 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:42.081058+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:10:43.151 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:42.083048+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:43.151 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:42.084194+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:43.151 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:42.085015+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:43.151 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:42.086063+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-07-20T15:10:43.151 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:42.086202+0000 mgr.y (mgr.34784) 87 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-07-20T15:10:43.152 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cephadm 2023-07-20T15:10:42.086801+0000 mgr.y (mgr.34784) 88 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2023-07-20T15:10:43.152 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:42.541535+0000 mon.a (mon.0) 270 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/2686715373,v1:172.21.15.29:6811/2686715373]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-20T15:10:43.152 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:41.785161+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:43.152 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:42.064631+0000 mgr.y (mgr.34784) 86 : cluster [DBG] pgmap v43: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 13 MiB used, 708 GiB / 715 GiB avail; 82/606 objects degraded (13.531%) 2023-07-20T15:10:43.152 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:42.076511+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:43.152 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:42.081058+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:10:43.153 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:42.083048+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:43.153 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:42.084194+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:43.153 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:42.085015+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:43.153 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:42.086063+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-07-20T15:10:43.153 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:42.086202+0000 mgr.y (mgr.34784) 87 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-07-20T15:10:43.153 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cephadm 2023-07-20T15:10:42.086801+0000 mgr.y (mgr.34784) 88 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2023-07-20T15:10:43.153 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:42 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:42.541535+0000 mon.a (mon.0) 270 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/2686715373,v1:172.21.15.29:6811/2686715373]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-20T15:10:43.173 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:42 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:41.785161+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:43.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:42 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:42.064631+0000 mgr.y (mgr.34784) 86 : cluster [DBG] pgmap v43: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 13 MiB used, 708 GiB / 715 GiB avail; 82/606 objects degraded (13.531%) 2023-07-20T15:10:43.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:42 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:42.076511+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' 2023-07-20T15:10:43.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:42 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:42.081058+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-20T15:10:43.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:42 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:42.083048+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:43.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:42 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:42.084194+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:43.175 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:42 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:42.085015+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:43.175 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:42 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:42.086063+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-07-20T15:10:43.175 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:42 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:42.086202+0000 mgr.y (mgr.34784) 87 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-07-20T15:10:43.175 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:42 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cephadm 2023-07-20T15:10:42.086801+0000 mgr.y (mgr.34784) 88 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2023-07-20T15:10:43.175 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:42 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:42.541535+0000 mon.a (mon.0) 270 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/2686715373,v1:172.21.15.29:6811/2686715373]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-20T15:10:43.453 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:43 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd-1[138019]: debug 2023-07-20T15:10:43.101+0000 7f2a52d3b700 -1 osd.1 83 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-20T15:10:43.477 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'ceph orch ps' 2023-07-20T15:10:44.365 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:43.080235+0000 mon.a (mon.0) 271 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/2686715373,v1:172.21.15.29:6811/2686715373]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-07-20T15:10:44.365 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:43.080386+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e86: 8 total, 7 up, 8 in 2023-07-20T15:10:44.365 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:43.080966+0000 mon.a (mon.0) 273 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/2686715373,v1:172.21.15.29:6811/2686715373]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:10:44.366 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:43.080235+0000 mon.a (mon.0) 271 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/2686715373,v1:172.21.15.29:6811/2686715373]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-07-20T15:10:44.366 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:43.080386+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e86: 8 total, 7 up, 8 in 2023-07-20T15:10:44.366 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:44 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:43.080966+0000 mon.a (mon.0) 273 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/2686715373,v1:172.21.15.29:6811/2686715373]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:10:44.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:44 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:43.080235+0000 mon.a (mon.0) 271 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/2686715373,v1:172.21.15.29:6811/2686715373]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-07-20T15:10:44.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:44 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:43.080386+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e86: 8 total, 7 up, 8 in 2023-07-20T15:10:44.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:44 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:43.080966+0000 mon.a (mon.0) 273 : audit [INF] from='osd.1 [v2:172.21.15.29:6810/2686715373,v1:172.21.15.29:6811/2686715373]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-07-20T15:10:44.424 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[108998]: debug 2023-07-20T15:10:44.087+0000 7f43c63bc700 -1 osd.4 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.424 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[108998]: debug 2023-07-20T15:10:44.087+0000 7f43cb3c6700 -1 osd.4 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.425 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[108998]: debug 2023-07-20T15:10:44.087+0000 7f43c8bc1700 -1 osd.4 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.425 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[108998]: debug 2023-07-20T15:10:44.087+0000 7f43c63bc700 -1 osd.4 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.425 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[108998]: debug 2023-07-20T15:10:44.088+0000 7f43cabc5700 -1 osd.4 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.425 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[108998]: debug 2023-07-20T15:10:44.089+0000 7f43c93c2700 -1 osd.4 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.425 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[108998]: debug 2023-07-20T15:10:44.158+0000 7f43c83c0700 -1 osd.4 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.425 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[108998]: debug 2023-07-20T15:10:44.158+0000 7f43cabc5700 -1 osd.4 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.425 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[108998]: debug 2023-07-20T15:10:44.158+0000 7f43c4bb9700 -1 osd.4 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.426 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[113296]: debug 2023-07-20T15:10:44.093+0000 7f304f867700 -1 osd.6 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.426 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[113296]: debug 2023-07-20T15:10:44.095+0000 7f304985b700 -1 osd.6 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.426 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[113296]: debug 2023-07-20T15:10:44.097+0000 7f305106a700 -1 osd.6 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.426 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[113296]: debug 2023-07-20T15:10:44.099+0000 7f304c060700 -1 osd.6 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.426 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[113296]: debug 2023-07-20T15:10:44.158+0000 7f304d863700 -1 osd.6 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.427 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[113811]: debug 2023-07-20T15:10:44.092+0000 7fe65c726700 -1 osd.7 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.427 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[113811]: debug 2023-07-20T15:10:44.093+0000 7fe662732700 -1 osd.7 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.427 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[113811]: debug 2023-07-20T15:10:44.093+0000 7fe65f72c700 -1 osd.7 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.427 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[113811]: debug 2023-07-20T15:10:44.094+0000 7fe65f72c700 -1 osd.7 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.427 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[113811]: debug 2023-07-20T15:10:44.097+0000 7fe661730700 -1 osd.7 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.427 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:10:44 smithi178 bash[113811]: debug 2023-07-20T15:10:44.261+0000 7fe65bf25700 -1 osd.7 87 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:44.715 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-07-20T15:10:44.715 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.a smithi029 running (2m) 2s ago 7m 19.0M - 0.25.0 c8568f914cd2 27a8d3f42bb2 2023-07-20T15:10:44.715 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.a smithi178 running (6m) 48s ago 6m 31.6M - 6.6.2 87a51ecf0b1c 875ebfddec5b 2023-07-20T15:10:44.715 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.x smithi178 *:8443 running (90s) 48s ago 9m 389M - 16.2.13-355-ge2018073 247668761b27 12901326ede7 2023-07-20T15:10:44.715 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.y smithi029 *:8443 running (2m) 2s ago 10m 433M - 16.2.13-355-ge2018073 247668761b27 891723c152d4 2023-07-20T15:10:44.716 INFO:teuthology.orchestra.run.smithi029.stdout:mon.a smithi029 running (83s) 2s ago 11m 131M 2048M 16.2.13-355-ge2018073 247668761b27 0c199917352e 2023-07-20T15:10:44.716 INFO:teuthology.orchestra.run.smithi029.stdout:mon.b smithi178 running (52s) 48s ago 9m 25.6M 2048M 16.2.13-355-ge2018073 247668761b27 f38e8b21640d 2023-07-20T15:10:44.716 INFO:teuthology.orchestra.run.smithi029.stdout:mon.c smithi029 running (60s) 2s ago 9m 49.1M 2048M 16.2.13-355-ge2018073 247668761b27 35b78756c758 2023-07-20T15:10:44.716 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.a smithi029 running (7m) 2s ago 7m 13.4M - 1.6.1 458e026e6aa6 a2b5070c8a7f 2023-07-20T15:10:44.716 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.b smithi178 running (7m) 48s ago 7m 10.8M - 1.6.1 458e026e6aa6 ae43907cd0d8 2023-07-20T15:10:44.717 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (29s) 2s ago 9m 54.2M 4096M 16.2.13-355-ge2018073 247668761b27 b8c65227a621 2023-07-20T15:10:44.717 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (5s) 2s ago 8m 16.6M 4096M 16.2.13-355-ge2018073 247668761b27 cd7f4b7e33b3 2023-07-20T15:10:44.717 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (8m) 2s ago 8m 69.2M 4096M 15.2.0 204a01f9b0b6 d60b18f8f253 2023-07-20T15:10:44.717 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi029 running (8m) 2s ago 8m 88.8M 4096M 15.2.0 204a01f9b0b6 0a92a9e1f2da 2023-07-20T15:10:44.717 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi178 running (7m) 48s ago 8m 83.2M 4096M 15.2.0 204a01f9b0b6 b133c6a0654f 2023-07-20T15:10:44.717 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi178 running (7m) 48s ago 7m 77.2M 4096M 15.2.0 204a01f9b0b6 405b4fc27850 2023-07-20T15:10:44.717 INFO:teuthology.orchestra.run.smithi029.stdout:osd.6 smithi178 running (7m) 48s ago 7m 69.3M 4096M 15.2.0 204a01f9b0b6 4311ccd86c8b 2023-07-20T15:10:44.718 INFO:teuthology.orchestra.run.smithi029.stdout:osd.7 smithi178 running (7m) 48s ago 7m 80.6M 4096M 15.2.0 204a01f9b0b6 b2a3cd19518d 2023-07-20T15:10:44.718 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.a smithi178 running (2m) 48s ago 7m 38.1M - 2.45.0 e1fbd49323c6 71bc04964ce1 2023-07-20T15:10:44.718 INFO:teuthology.orchestra.run.smithi029.stdout:rgw.r.z.smithi029.fdztmk smithi029 running (6m) 2s ago 6m 54.6M - 15.2.0 204a01f9b0b6 45851ddbab0f 2023-07-20T15:10:44.718 INFO:teuthology.orchestra.run.smithi029.stdout:rgw.r.z.smithi178.bnfxtc smithi178 running (6m) 48s ago 6m 55.2M - 15.2.0 204a01f9b0b6 653ff44a4683 2023-07-20T15:10:45.081 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'ceph versions' 2023-07-20T15:10:45.332 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:44.065091+0000 mgr.y (mgr.34784) 89 : cluster [DBG] pgmap v45: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 17 MiB used, 709 GiB / 715 GiB avail; 82/606 objects degraded (13.531%) 2023-07-20T15:10:45.333 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:44.077232+0000 mon.a (mon.0) 274 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:10:45.333 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:44.084366+0000 mon.a (mon.0) 275 : cluster [INF] osd.1 [v2:172.21.15.29:6810/2686715373,v1:172.21.15.29:6811/2686715373] boot 2023-07-20T15:10:45.333 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:44.084428+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2023-07-20T15:10:45.333 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:44.084786+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:10:45.333 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:44.656048+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2023-07-20T15:10:45.334 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:44.656423+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2023-07-20T15:10:45.334 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:44.656736+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.334 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:44.657048+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.334 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:44.657330+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.334 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:44.657634+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.334 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:44.659204+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2023-07-20T15:10:45.334 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:44.659541+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.335 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:44.659857+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.335 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:44.660147+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.335 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:44.660438+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.335 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:44.065091+0000 mgr.y (mgr.34784) 89 : cluster [DBG] pgmap v45: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 17 MiB used, 709 GiB / 715 GiB avail; 82/606 objects degraded (13.531%) 2023-07-20T15:10:45.335 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:44.077232+0000 mon.a (mon.0) 274 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:10:45.335 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:44.084366+0000 mon.a (mon.0) 275 : cluster [INF] osd.1 [v2:172.21.15.29:6810/2686715373,v1:172.21.15.29:6811/2686715373] boot 2023-07-20T15:10:45.336 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:44.084428+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2023-07-20T15:10:45.336 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:44.084786+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:10:45.336 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:44.656048+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2023-07-20T15:10:45.336 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:44.656423+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2023-07-20T15:10:45.336 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:44.656736+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.336 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:44.657048+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.336 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:44.657330+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.337 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:44.657634+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.337 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:44.659204+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2023-07-20T15:10:45.337 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:44.659541+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.337 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:44.659857+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.337 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:44.660147+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.337 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:45 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:44.660438+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:45 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:44.065091+0000 mgr.y (mgr.34784) 89 : cluster [DBG] pgmap v45: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 17 MiB used, 709 GiB / 715 GiB avail; 82/606 objects degraded (13.531%) 2023-07-20T15:10:45.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:45 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:44.077232+0000 mon.a (mon.0) 274 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-07-20T15:10:45.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:45 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:44.084366+0000 mon.a (mon.0) 275 : cluster [INF] osd.1 [v2:172.21.15.29:6810/2686715373,v1:172.21.15.29:6811/2686715373] boot 2023-07-20T15:10:45.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:45 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:44.084428+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2023-07-20T15:10:45.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:45 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:44.084786+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-20T15:10:45.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:45 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:44.656048+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2023-07-20T15:10:45.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:45 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:44.656423+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2023-07-20T15:10:45.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:45 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:44.656736+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:45 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:44.657048+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:45 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:44.657330+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:45 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:44.657634+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:45 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:44.659204+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2023-07-20T15:10:45.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:45 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:44.659541+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:45 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:44.659857+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:45 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:44.660147+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:45.425 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:45 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:44.660438+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.34784 172.21.15.29:0/2185705001' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2023-07-20T15:10:46.415 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-07-20T15:10:46.415 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-07-20T15:10:46.415 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)": 3 2023-07-20T15:10:46.416 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:10:46.416 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-07-20T15:10:46.416 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)": 2 2023-07-20T15:10:46.416 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:10:46.416 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-07-20T15:10:46.416 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 6, 2023-07-20T15:10:46.416 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)": 2 2023-07-20T15:10:46.417 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:10:46.417 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": {}, 2023-07-20T15:10:46.417 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw": { 2023-07-20T15:10:46.417 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2023-07-20T15:10:46.417 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-07-20T15:10:46.417 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-07-20T15:10:46.417 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8, 2023-07-20T15:10:46.418 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)": 7 2023-07-20T15:10:46.418 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-07-20T15:10:46.418 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-07-20T15:10:46.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:46 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:44.654204+0000 mgr.y (mgr.34784) 90 : audit [DBG] from='client.54115 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:10:46.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:46 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:45.090423+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2023-07-20T15:10:46.446 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:44.654204+0000 mgr.y (mgr.34784) 90 : audit [DBG] from='client.54115 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:10:46.446 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:45.090423+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2023-07-20T15:10:46.447 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:44.654204+0000 mgr.y (mgr.34784) 90 : audit [DBG] from='client.54115 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-20T15:10:46.447 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:46 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:45.090423+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2023-07-20T15:10:46.789 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2023-07-20T15:10:47.299 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:47 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:46.065704+0000 mgr.y (mgr.34784) 91 : cluster [DBG] pgmap v48: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 17 MiB used, 709 GiB / 715 GiB avail; 82/606 objects degraded (13.531%) 2023-07-20T15:10:47.300 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:47 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: cluster 2023-07-20T15:10:46.351807+0000 mon.a (mon.0) 290 : cluster [WRN] Health check update: Degraded data redundancy: 82/606 objects degraded (13.531%), 21 pgs degraded (PG_DEGRADED) 2023-07-20T15:10:47.300 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:47 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:46.366009+0000 mon.c (mon.1) 5 : audit [DBG] from='client.44157 172.21.15.29:0/3734794660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:47.300 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:47 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:46.065704+0000 mgr.y (mgr.34784) 91 : cluster [DBG] pgmap v48: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 17 MiB used, 709 GiB / 715 GiB avail; 82/606 objects degraded (13.531%) 2023-07-20T15:10:47.300 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:47 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: cluster 2023-07-20T15:10:46.351807+0000 mon.a (mon.0) 290 : cluster [WRN] Health check update: Degraded data redundancy: 82/606 objects degraded (13.531%), 21 pgs degraded (PG_DEGRADED) 2023-07-20T15:10:47.300 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:47 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:46.366009+0000 mon.c (mon.1) 5 : audit [DBG] from='client.44157 172.21.15.29:0/3734794660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:47.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:47 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:46.065704+0000 mgr.y (mgr.34784) 91 : cluster [DBG] pgmap v48: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 17 MiB used, 709 GiB / 715 GiB avail; 82/606 objects degraded (13.531%) 2023-07-20T15:10:47.423 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:47 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: cluster 2023-07-20T15:10:46.351807+0000 mon.a (mon.0) 290 : cluster [WRN] Health check update: Degraded data redundancy: 82/606 objects degraded (13.531%), 21 pgs degraded (PG_DEGRADED) 2023-07-20T15:10:47.424 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:47 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:46.366009+0000 mon.c (mon.1) 5 : audit [DBG] from='client.44157 172.21.15.29:0/3734794660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:48.072 INFO:teuthology.orchestra.run.smithi029.stdout:false 2023-07-20T15:10:48.406 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:48 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: audit 2023-07-20T15:10:48.012064+0000 mon.c (mon.1) 6 : audit [DBG] from='client.54127 172.21.15.29:0/3113150251' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:48.406 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:48 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: audit 2023-07-20T15:10:48.012064+0000 mon.c (mon.1) 6 : audit [DBG] from='client.54127 172.21.15.29:0/3113150251' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:48.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T15:10:48.407 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 84, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_e20180733e4b085d1abe55675eb8c828b0bfedec/qa/tasks/cephadm.py", line 1053, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_ceph_ceph-c_e20180733e4b085d1abe55675eb8c828b0bfedec/qa/tasks/cephadm.py", line 34, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-07-20T15:10:48.471 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=92b9cc6e24124694bda2b3cf0e401eb9 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 84, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_e20180733e4b085d1abe55675eb8c828b0bfedec/qa/tasks/cephadm.py", line 1053, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_ceph_ceph-c_e20180733e4b085d1abe55675eb8c828b0bfedec/qa/tasks/cephadm.py", line 34, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-07-20T15:10:48.474 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-07-20T15:10:48.483 INFO:tasks.cephadm:Teardown begin 2023-07-20T15:10:48.484 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-20T15:10:48.488 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:10:48 smithi178 bash[113296]: debug 2023-07-20T15:10:48.001+0000 7f304d863700 -1 osd.6 88 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:48.488 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:48 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: audit 2023-07-20T15:10:48.012064+0000 mon.c (mon.1) 6 : audit [DBG] from='client.54127 172.21.15.29:0/3113150251' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-07-20T15:10:48.489 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:10:48 smithi178 bash[108998]: debug 2023-07-20T15:10:48.001+0000 7f43c43b8700 -1 osd.4 88 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:48.489 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:10:48 smithi178 bash[108998]: debug 2023-07-20T15:10:48.001+0000 7f43c6bbd700 -1 osd.4 88 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:48.489 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:10:48 smithi178 bash[108998]: debug 2023-07-20T15:10:48.001+0000 7f43c8bc1700 -1 osd.4 88 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:48.489 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:10:48 smithi178 bash[113811]: debug 2023-07-20T15:10:48.111+0000 7fe65bf25700 -1 osd.7 88 build_incremental_map_msg missing incremental map 87 2023-07-20T15:10:48.517 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-20T15:10:48.555 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-07-20T15:10:48.556 DEBUG:teuthology.orchestra.run.smithi029:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-07-20T15:10:48.574 DEBUG:teuthology.orchestra.run.smithi178:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-07-20T15:10:48.616 INFO:tasks.cephadm:Stopping all daemons... 2023-07-20T15:10:48.617 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-07-20T15:10:48.617 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.a 2023-07-20T15:10:48.678 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:48 smithi029 systemd[1]: Stopping Ceph mon.a for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:10:48.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:48 smithi029 bash[139387]: Error: no container with name or ID "ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon.a" found: no such container 2023-07-20T15:10:48.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:48 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:10:48.833+0000 7f02f4319700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-07-20T15:10:48.954 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:48 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a[132118]: debug 2023-07-20T15:10:48.833+0000 7f02f4319700 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2023-07-20T15:10:49.446 INFO:journalctl@ceph.mon.a.smithi029.stdout:Jul 20 15:10:49 smithi029 bash[139425]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-a 2023-07-20T15:10:49.453 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.a.service' 2023-07-20T15:10:49.506 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-20T15:10:49.506 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-07-20T15:10:49.507 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-07-20T15:10:49.507 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.c 2023-07-20T15:10:49.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:49 smithi029 systemd[1]: Stopping Ceph mon.c for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:10:49.703 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:49 smithi029 bash[139546]: Error: no container with name or ID "ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon.c" found: no such container 2023-07-20T15:10:50.172 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:10:49.707+0000 7f57c4f14700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-07-20T15:10:50.173 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:49 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c[134086]: debug 2023-07-20T15:10:49.707+0000 7f57c4f14700 -1 mon.c@1(peon) e4 *** Got Signal Terminated *** 2023-07-20T15:10:50.173 INFO:journalctl@ceph.mon.c.smithi029.stdout:Jul 20 15:10:49 smithi029 bash[139586]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-c 2023-07-20T15:10:50.178 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.c.service' 2023-07-20T15:10:50.214 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-20T15:10:50.215 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-07-20T15:10:50.215 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2023-07-20T15:10:50.216 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.b 2023-07-20T15:10:50.671 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:50 smithi178 systemd[1]: Stopping Ceph mon.b for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:10:50.672 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:50 smithi178 bash[126963]: Error: no container with name or ID "ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon.b" found: no such container 2023-07-20T15:10:50.672 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:50 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:10:50.445+0000 7fcff6c15700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-07-20T15:10:50.672 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:50 smithi178 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b[125516]: debug 2023-07-20T15:10:50.445+0000 7fcff6c15700 -1 mon.b@2(peon) e4 *** Got Signal Terminated *** 2023-07-20T15:10:50.923 INFO:journalctl@ceph.mon.b.smithi178.stdout:Jul 20 15:10:50 smithi178 bash[127002]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-mon-b 2023-07-20T15:10:51.042 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@mon.b.service' 2023-07-20T15:10:51.099 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-20T15:10:51.100 INFO:tasks.cephadm.mon.b:Stopped mon.b 2023-07-20T15:10:51.100 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-07-20T15:10:51.101 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.y 2023-07-20T15:10:51.390 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:10:51 smithi029 systemd[1]: Stopping Ceph mgr.y for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:10:51.391 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:10:51 smithi029 bash[139706]: Error: no container with name or ID "ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr.y" found: no such container 2023-07-20T15:10:51.391 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:10:51 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:10:51.340+0000 7fd6b93f6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-07-20T15:10:51.391 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:10:51 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y[130099]: debug 2023-07-20T15:10:51.340+0000 7fd6b93f6700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-07-20T15:10:51.703 INFO:journalctl@ceph.mgr.y.smithi029.stdout:Jul 20 15:10:51 smithi029 bash[139744]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-y 2023-07-20T15:10:51.845 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.y.service' 2023-07-20T15:10:51.882 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-20T15:10:51.883 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-07-20T15:10:51.883 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-07-20T15:10:51.884 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.x 2023-07-20T15:10:52.173 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:10:51 smithi178 systemd[1]: Stopping Ceph mgr.x for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:10:52.174 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:10:51 smithi178 bash[127122]: Error: no container with name or ID "ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr.x" found: no such container 2023-07-20T15:10:52.672 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:10:52 smithi178 bash[127160]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-mgr-x 2023-07-20T15:10:52.673 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Jul 20 15:10:52 smithi178 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.x.service: Main process exited, code=exited, status=143/n/a 2023-07-20T15:10:52.678 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@mgr.x.service' 2023-07-20T15:10:52.715 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-20T15:10:52.715 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-07-20T15:10:52.716 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-07-20T15:10:52.716 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.0 2023-07-20T15:10:53.203 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:52 smithi029 systemd[1]: Stopping Ceph osd.0 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:10:53.203 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:52 smithi029 bash[139864]: Error: no container with name or ID "ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.0" found: no such container 2023-07-20T15:10:53.204 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:52 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd-0[136350]: debug 2023-07-20T15:10:52.940+0000 7f6d32c94700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-07-20T15:10:53.204 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:52 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd-0[136350]: debug 2023-07-20T15:10:52.940+0000 7f6d32c94700 -1 osd.0 88 *** Got signal Terminated *** 2023-07-20T15:10:53.204 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:52 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd-0[136350]: debug 2023-07-20T15:10:52.940+0000 7f6d32c94700 -1 osd.0 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-20T15:10:58.453 INFO:journalctl@ceph.osd.0.smithi029.stdout:Jul 20 15:10:58 smithi029 bash[139902]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd-0 2023-07-20T15:10:59.315 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.0.service' 2023-07-20T15:10:59.357 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-20T15:10:59.358 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-07-20T15:10:59.358 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-07-20T15:10:59.358 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.1 2023-07-20T15:10:59.645 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:59 smithi029 systemd[1]: Stopping Ceph osd.1 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:10:59.646 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:59 smithi029 bash[140134]: Error: no container with name or ID "ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.1" found: no such container 2023-07-20T15:10:59.953 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd-1[138019]: debug 2023-07-20T15:10:59.595+0000 7f2a5adc8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-07-20T15:10:59.953 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd-1[138019]: debug 2023-07-20T15:10:59.595+0000 7f2a5adc8700 -1 osd.1 88 *** Got signal Terminated *** 2023-07-20T15:10:59.954 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:10:59 smithi029 ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd-1[138019]: debug 2023-07-20T15:10:59.595+0000 7f2a5adc8700 -1 osd.1 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-20T15:11:05.204 INFO:journalctl@ceph.osd.1.smithi029.stdout:Jul 20 15:11:04 smithi029 bash[140173]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd-1 2023-07-20T15:11:06.073 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.1.service' 2023-07-20T15:11:06.116 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-20T15:11:06.116 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-07-20T15:11:06.116 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-07-20T15:11:06.117 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.2 2023-07-20T15:11:06.453 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:11:06 smithi029 systemd[1]: Stopping Ceph osd.2 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:11:06.454 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:11:06 smithi029 bash[116908]: debug 2023-07-20T15:11:06.205+0000 7fb27957d700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T15:11:06.454 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:11:06 smithi029 bash[116908]: debug 2023-07-20T15:11:06.205+0000 7fb27957d700 -1 osd.2 88 *** Got signal Terminated *** 2023-07-20T15:11:06.454 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:11:06 smithi029 bash[116908]: debug 2023-07-20T15:11:06.205+0000 7fb27957d700 -1 osd.2 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-20T15:11:06.890 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:11:06 smithi029 bash[140422]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.2 2023-07-20T15:11:06.890 INFO:journalctl@ceph.osd.2.smithi029.stdout:Jul 20 15:11:06 smithi029 bash[140461]: bash: /var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/osd.2/unit.stop: No such file or directory 2023-07-20T15:11:07.381 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.2.service' 2023-07-20T15:11:07.421 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-20T15:11:07.422 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-07-20T15:11:07.422 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-07-20T15:11:07.422 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.3 2023-07-20T15:11:07.704 INFO:journalctl@ceph.osd.3.smithi029.stdout:Jul 20 15:11:07 smithi029 systemd[1]: Stopping Ceph osd.3 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:11:07.704 INFO:journalctl@ceph.osd.3.smithi029.stdout:Jul 20 15:11:07 smithi029 bash[117321]: debug 2023-07-20T15:11:07.501+0000 7f501950e700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T15:11:07.704 INFO:journalctl@ceph.osd.3.smithi029.stdout:Jul 20 15:11:07 smithi029 bash[117321]: debug 2023-07-20T15:11:07.501+0000 7f501950e700 -1 osd.3 88 *** Got signal Terminated *** 2023-07-20T15:11:07.705 INFO:journalctl@ceph.osd.3.smithi029.stdout:Jul 20 15:11:07 smithi029 bash[117321]: debug 2023-07-20T15:11:07.501+0000 7f501950e700 -1 osd.3 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-20T15:11:08.203 INFO:journalctl@ceph.osd.3.smithi029.stdout:Jul 20 15:11:07 smithi029 bash[140582]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.3 2023-07-20T15:11:08.204 INFO:journalctl@ceph.osd.3.smithi029.stdout:Jul 20 15:11:07 smithi029 bash[140624]: bash: /var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/osd.3/unit.stop: No such file or directory 2023-07-20T15:11:08.656 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.3.service' 2023-07-20T15:11:08.695 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-20T15:11:08.696 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-07-20T15:11:08.696 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-07-20T15:11:08.697 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.4 2023-07-20T15:11:09.025 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:11:08 smithi178 systemd[1]: Stopping Ceph osd.4 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:11:09.026 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:11:08 smithi178 bash[108998]: debug 2023-07-20T15:11:08.766+0000 7f43e4c69700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T15:11:09.026 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:11:08 smithi178 bash[108998]: debug 2023-07-20T15:11:08.766+0000 7f43e4c69700 -1 osd.4 88 *** Got signal Terminated *** 2023-07-20T15:11:09.026 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:11:08 smithi178 bash[108998]: debug 2023-07-20T15:11:08.766+0000 7f43e4c69700 -1 osd.4 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-20T15:11:09.423 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:11:09 smithi178 bash[127284]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.4 2023-07-20T15:11:09.424 INFO:journalctl@ceph.osd.4.smithi178.stdout:Jul 20 15:11:09 smithi178 bash[127326]: bash: /var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/osd.4/unit.stop: No such file or directory 2023-07-20T15:11:09.883 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.4.service' 2023-07-20T15:11:09.924 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-20T15:11:09.925 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-07-20T15:11:09.925 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-07-20T15:11:09.925 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.5 2023-07-20T15:11:10.142 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:11:09 smithi178 systemd[1]: Stopping Ceph osd.5 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:11:10.143 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:11:10 smithi178 bash[111080]: debug 2023-07-20T15:11:10.040+0000 7f13fd570700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T15:11:10.143 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:11:10 smithi178 bash[111080]: debug 2023-07-20T15:11:10.040+0000 7f13fd570700 -1 osd.5 88 *** Got signal Terminated *** 2023-07-20T15:11:10.143 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:11:10 smithi178 bash[111080]: debug 2023-07-20T15:11:10.040+0000 7f13fd570700 -1 osd.5 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-20T15:11:10.674 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:11:10 smithi178 bash[127442]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.5 2023-07-20T15:11:10.674 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jul 20 15:11:10 smithi178 bash[127482]: bash: /var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/osd.5/unit.stop: No such file or directory 2023-07-20T15:11:11.198 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.5.service' 2023-07-20T15:11:11.239 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-20T15:11:11.239 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-07-20T15:11:11.240 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-07-20T15:11:11.240 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.6 2023-07-20T15:11:11.479 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:11:11 smithi178 systemd[1]: Stopping Ceph osd.6 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:11:11.480 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:11:11 smithi178 bash[113296]: debug 2023-07-20T15:11:11.379+0000 7f306a90d700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T15:11:11.480 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:11:11 smithi178 bash[113296]: debug 2023-07-20T15:11:11.379+0000 7f306a90d700 -1 osd.6 88 *** Got signal Terminated *** 2023-07-20T15:11:11.480 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:11:11 smithi178 bash[113296]: debug 2023-07-20T15:11:11.379+0000 7f306a90d700 -1 osd.6 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-20T15:11:12.026 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:11:11 smithi178 bash[127599]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.6 2023-07-20T15:11:12.026 INFO:journalctl@ceph.osd.6.smithi178.stdout:Jul 20 15:11:11 smithi178 bash[127641]: bash: /var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/osd.6/unit.stop: No such file or directory 2023-07-20T15:11:12.515 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.6.service' 2023-07-20T15:11:12.555 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-20T15:11:12.555 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-07-20T15:11:12.556 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-07-20T15:11:12.556 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.7 2023-07-20T15:11:12.782 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:11:12 smithi178 systemd[1]: Stopping Ceph osd.7 for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:11:12.783 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:11:12 smithi178 bash[113811]: debug 2023-07-20T15:11:12.692+0000 7fe67ffdd700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2023-07-20T15:11:12.783 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:11:12 smithi178 bash[113811]: debug 2023-07-20T15:11:12.692+0000 7fe67ffdd700 -1 osd.7 88 *** Got signal Terminated *** 2023-07-20T15:11:12.783 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:11:12 smithi178 bash[113811]: debug 2023-07-20T15:11:12.692+0000 7fe67ffdd700 -1 osd.7 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-20T15:11:13.424 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:11:13 smithi178 bash[127759]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-osd.7 2023-07-20T15:11:13.424 INFO:journalctl@ceph.osd.7.smithi178.stdout:Jul 20 15:11:13 smithi178 bash[127801]: bash: /var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/osd.7/unit.stop: No such file or directory 2023-07-20T15:11:13.899 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@osd.7.service' 2023-07-20T15:11:13.938 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-20T15:11:13.938 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-07-20T15:11:13.939 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2023-07-20T15:11:13.939 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-021c9860-270e-11ee-9b34-001a4aab830c@prometheus.a 2023-07-20T15:11:14.150 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:11:13 smithi178 systemd[1]: Stopping Ceph prometheus.a for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:11:14.151 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:11:14 smithi178 bash[121482]: ts=2023-07-20T15:11:14.038Z caller=main.go:854 level=warn msg="Received SIGTERM, exiting gracefully..." 2023-07-20T15:11:14.151 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:11:14 smithi178 bash[121482]: ts=2023-07-20T15:11:14.038Z caller=main.go:878 level=info msg="Stopping scrape discovery manager..." 2023-07-20T15:11:14.151 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:11:14 smithi178 bash[121482]: ts=2023-07-20T15:11:14.038Z caller=main.go:892 level=info msg="Stopping notify discovery manager..." 2023-07-20T15:11:14.152 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:11:14 smithi178 bash[121482]: ts=2023-07-20T15:11:14.038Z caller=manager.go:1009 level=info component="rule manager" msg="Stopping rule manager..." 2023-07-20T15:11:14.152 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:11:14 smithi178 bash[121482]: ts=2023-07-20T15:11:14.038Z caller=main.go:874 level=info msg="Scrape discovery manager stopped" 2023-07-20T15:11:14.152 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:11:14 smithi178 bash[121482]: ts=2023-07-20T15:11:14.038Z caller=main.go:888 level=info msg="Notify discovery manager stopped" 2023-07-20T15:11:14.152 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:11:14 smithi178 bash[121482]: ts=2023-07-20T15:11:14.038Z caller=manager.go:1019 level=info component="rule manager" msg="Rule manager stopped" 2023-07-20T15:11:14.152 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:11:14 smithi178 bash[121482]: ts=2023-07-20T15:11:14.038Z caller=main.go:929 level=info msg="Stopping scrape manager..." 2023-07-20T15:11:14.153 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:11:14 smithi178 bash[121482]: ts=2023-07-20T15:11:14.039Z caller=main.go:921 level=info msg="Scrape manager stopped" 2023-07-20T15:11:14.153 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:11:14 smithi178 bash[121482]: ts=2023-07-20T15:11:14.039Z caller=notifier.go:603 level=info component=notifier msg="Stopping notification manager..." 2023-07-20T15:11:14.153 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:11:14 smithi178 bash[121482]: ts=2023-07-20T15:11:14.039Z caller=main.go:1150 level=info msg="Notifier manager stopped" 2023-07-20T15:11:14.153 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Jul 20 15:11:14 smithi178 bash[121482]: ts=2023-07-20T15:11:14.039Z caller=main.go:1162 level=info msg="See you next time!" 2023-07-20T15:11:14.529 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-021c9860-270e-11ee-9b34-001a4aab830c@prometheus.a.service' 2023-07-20T15:11:14.565 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-20T15:11:14.566 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2023-07-20T15:11:14.566 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 021c9860-270e-11ee-9b34-001a4aab830c --force --keep-logs 2023-07-20T15:11:14.705 INFO:teuthology.orchestra.run.smithi029.stderr:usage: cephadm [-h] [--image IMAGE] [--docker] [--data-dir DATA_DIR] 2023-07-20T15:11:14.706 INFO:teuthology.orchestra.run.smithi029.stderr: [--log-dir LOG_DIR] [--logrotate-dir LOGROTATE_DIR] 2023-07-20T15:11:14.706 INFO:teuthology.orchestra.run.smithi029.stderr: [--unit-dir UNIT_DIR] [--verbose] [--timeout TIMEOUT] 2023-07-20T15:11:14.706 INFO:teuthology.orchestra.run.smithi029.stderr: [--retry RETRY] 2023-07-20T15:11:14.707 INFO:teuthology.orchestra.run.smithi029.stderr: {version,pull,inspect-image,ls,list-networks,adopt,rm-daemon,rm-cluster,run,shell,enter,ceph-volume,unit,logs,bootstrap,deploy,check-host,prepare-host,add-repo,rm-repo,install} 2023-07-20T15:11:14.707 INFO:teuthology.orchestra.run.smithi029.stderr: ... 2023-07-20T15:11:14.707 INFO:teuthology.orchestra.run.smithi029.stderr:cephadm: error: unrecognized arguments: --keep-logs 2023-07-20T15:11:14.715 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-20T15:11:14.716 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 021c9860-270e-11ee-9b34-001a4aab830c --force --keep-logs 2023-07-20T15:11:14.835 INFO:teuthology.orchestra.run.smithi178.stderr:usage: cephadm [-h] [--image IMAGE] [--docker] [--data-dir DATA_DIR] 2023-07-20T15:11:14.836 INFO:teuthology.orchestra.run.smithi178.stderr: [--log-dir LOG_DIR] [--logrotate-dir LOGROTATE_DIR] 2023-07-20T15:11:14.836 INFO:teuthology.orchestra.run.smithi178.stderr: [--unit-dir UNIT_DIR] [--verbose] [--timeout TIMEOUT] 2023-07-20T15:11:14.836 INFO:teuthology.orchestra.run.smithi178.stderr: [--retry RETRY] 2023-07-20T15:11:14.836 INFO:teuthology.orchestra.run.smithi178.stderr: {version,pull,inspect-image,ls,list-networks,adopt,rm-daemon,rm-cluster,run,shell,enter,ceph-volume,unit,logs,bootstrap,deploy,check-host,prepare-host,add-repo,rm-repo,install} 2023-07-20T15:11:14.837 INFO:teuthology.orchestra.run.smithi178.stderr: ... 2023-07-20T15:11:14.837 INFO:teuthology.orchestra.run.smithi178.stderr:cephadm: error: unrecognized arguments: --keep-logs 2023-07-20T15:11:14.844 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-20T15:11:14.845 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-20T15:11:14.874 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-20T15:11:14.901 INFO:tasks.cephadm:Archiving crash dumps... 2023-07-20T15:11:14.903 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/crash to /home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344744/remote/ubuntu@smithi029.front.sepia.ceph.com/crash 2023-07-20T15:11:14.904 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/crash -- . 2023-07-20T15:11:14.958 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/crash to /home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344744/remote/ubuntu@smithi178.front.sepia.ceph.com/crash 2023-07-20T15:11:14.959 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/crash -- . 2023-07-20T15:11:15.025 INFO:tasks.cephadm:Checking cluster log for badness... 2023-07-20T15:11:15.026 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-07-20T15:11:15.055 INFO:teuthology.orchestra.run.smithi029.stderr:grep: /var/log/ceph/021c9860-270e-11ee-9b34-001a4aab830c/ceph.log: No such file or directory 2023-07-20T15:11:15.056 INFO:tasks.cephadm:Compressing logs... 2023-07-20T15:11:15.056 DEBUG:teuthology.orchestra.run.smithi029:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-20T15:11:15.098 DEBUG:teuthology.orchestra.run.smithi178:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-20T15:11:15.124 INFO:teuthology.orchestra.run.smithi029.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-07-20T15:11:15.126 INFO:teuthology.orchestra.run.smithi178.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-07-20T15:11:17.919 INFO:tasks.cephadm:Archiving logs... 2023-07-20T15:11:17.920 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344744/remote/ubuntu@smithi029.front.sepia.ceph.com/log 2023-07-20T15:11:17.921 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-20T15:11:18.258 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344744/remote/ubuntu@smithi178.front.sepia.ceph.com/log 2023-07-20T15:11:18.259 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-20T15:11:18.475 INFO:tasks.cephadm:Removing cluster... 2023-07-20T15:11:18.475 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 021c9860-270e-11ee-9b34-001a4aab830c --force 2023-07-20T15:11:19.635 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:11:19 smithi029 systemd[1]: Stopping Ceph node-exporter.a for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:11:19.939 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:11:19 smithi029 bash[141102]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-node-exporter.a 2023-07-20T15:11:19.940 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:11:19 smithi029 bash[141139]: bash: /var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/node-exporter.a/unit.stop: No such file or directory 2023-07-20T15:11:20.204 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:11:20 smithi029 systemd[1]: Stopping Ceph alertmanager.a for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:11:20.205 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:11:20 smithi029 bash[129394]: ts=2023-07-20T15:11:20.080Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2023-07-20T15:11:20.205 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:11:19 smithi029 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@node-exporter.a.service: Main process exited, code=exited, status=2/INVALIDARGUMENT 2023-07-20T15:11:20.205 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:11:19 smithi029 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@node-exporter.a.service: Failed with result 'exit-code'. 2023-07-20T15:11:20.205 INFO:journalctl@ceph.node-exporter.a.smithi029.stdout:Jul 20 15:11:19 smithi029 systemd[1]: Stopped Ceph node-exporter.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:11:20.642 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:11:20 smithi029 bash[141175]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-alertmanager.a 2023-07-20T15:11:20.643 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:11:20 smithi029 bash[141213]: bash: /var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/alertmanager.a/unit.stop: No such file or directory 2023-07-20T15:11:20.643 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:11:20 smithi029 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@alertmanager.a.service: Succeeded. 2023-07-20T15:11:20.643 INFO:journalctl@ceph.alertmanager.a.smithi029.stdout:Jul 20 15:11:20 smithi029 systemd[1]: Stopped Ceph alertmanager.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:11:31.643 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 021c9860-270e-11ee-9b34-001a4aab830c --force 2023-07-20T15:11:32.921 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:11:32 smithi178 systemd[1]: Stopping Ceph node-exporter.b for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:11:33.174 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:11:32 smithi178 bash[128343]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-node-exporter.b 2023-07-20T15:11:33.174 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:11:32 smithi178 bash[128380]: bash: /var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/node-exporter.b/unit.stop: No such file or directory 2023-07-20T15:11:33.175 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:11:33 smithi178 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@node-exporter.b.service: Main process exited, code=exited, status=2/INVALIDARGUMENT 2023-07-20T15:11:33.175 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:11:33 smithi178 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@node-exporter.b.service: Failed with result 'exit-code'. 2023-07-20T15:11:33.175 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Jul 20 15:11:33 smithi178 systemd[1]: Stopped Ceph node-exporter.b for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:11:33.529 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 systemd[1]: Stopping Ceph grafana.a for 021c9860-270e-11ee-9b34-001a4aab830c... 2023-07-20T15:11:33.530 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 bash[116267]: t=2023-07-20T15:11:33+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2023-07-20T15:11:33.530 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 bash[116267]: t=2023-07-20T15:11:33+0000 lvl=info msg="Stopped NotificationService" logger=server reason="context canceled" 2023-07-20T15:11:33.530 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 bash[116267]: t=2023-07-20T15:11:33+0000 lvl=info msg="Stopped Stream Manager" 2023-07-20T15:11:33.530 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 bash[116267]: t=2023-07-20T15:11:33+0000 lvl=info msg="Stopped PluginManager" logger=server reason="context canceled" 2023-07-20T15:11:33.531 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 bash[116267]: t=2023-07-20T15:11:33+0000 lvl=info msg="Stopped InternalMetricsService" logger=server reason="context canceled" 2023-07-20T15:11:33.531 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 bash[116267]: t=2023-07-20T15:11:33+0000 lvl=info msg="Stopped RemoteCache" logger=server reason="context canceled" 2023-07-20T15:11:33.531 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 bash[116267]: t=2023-07-20T15:11:33+0000 lvl=info msg="Stopped provisioningServiceImpl" logger=server reason="context canceled" 2023-07-20T15:11:33.531 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 bash[116267]: t=2023-07-20T15:11:33+0000 lvl=info msg="Stopped AlertEngine" logger=server reason="context canceled" 2023-07-20T15:11:33.531 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 bash[116267]: t=2023-07-20T15:11:33+0000 lvl=info msg="Stopped BackendPluginManager" logger=server reason="context canceled" 2023-07-20T15:11:33.532 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 bash[116267]: t=2023-07-20T15:11:33+0000 lvl=info msg="Stopped UsageStatsService" logger=server reason="context canceled" 2023-07-20T15:11:33.532 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 bash[116267]: t=2023-07-20T15:11:33+0000 lvl=info msg="Stopped CleanUpService" logger=server reason="context canceled" 2023-07-20T15:11:33.532 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 bash[116267]: t=2023-07-20T15:11:33+0000 lvl=info msg="Stopped UserAuthTokenService" logger=server reason="context canceled" 2023-07-20T15:11:33.532 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 bash[116267]: t=2023-07-20T15:11:33+0000 lvl=eror msg="Server shutdown" logger=server reason=nil 2023-07-20T15:11:33.862 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 bash[128416]: ceph-021c9860-270e-11ee-9b34-001a4aab830c-grafana.a 2023-07-20T15:11:33.863 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 bash[128455]: bash: /var/lib/ceph/021c9860-270e-11ee-9b34-001a4aab830c/grafana.a/unit.stop: No such file or directory 2023-07-20T15:11:33.863 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@grafana.a.service: Main process exited, code=exited, status=1/FAILURE 2023-07-20T15:11:33.863 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 systemd[1]: ceph-021c9860-270e-11ee-9b34-001a4aab830c@grafana.a.service: Failed with result 'exit-code'. 2023-07-20T15:11:33.863 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Jul 20 15:11:33 smithi178 systemd[1]: Stopped Ceph grafana.a for 021c9860-270e-11ee-9b34-001a4aab830c. 2023-07-20T15:11:44.677 INFO:tasks.cephadm:Removing cephadm ... 2023-07-20T15:11:44.678 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/cephadm 2023-07-20T15:11:44.703 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf /home/ubuntu/cephtest/cephadm 2023-07-20T15:11:44.721 INFO:tasks.cephadm:Teardown complete 2023-07-20T15:11:44.722 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-20T15:11:44.731 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-20T15:11:44.732 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-20T15:11:44.745 DEBUG:teuthology.orchestra.run.smithi178:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-20T15:11:44.764 INFO:teuthology.orchestra.run.smithi029.stderr:bash: ntpq: command not found 2023-07-20T15:11:44.768 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-20T15:11:44.769 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2023-07-20T15:11:44.769 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 9 -1520us[-1544us] +/- 86ms 2023-07-20T15:11:44.769 INFO:teuthology.orchestra.run.smithi029.stdout:^* hv02.front.sepia.ceph.com 3 6 377 7 -883us[ -907us] +/- 64ms 2023-07-20T15:11:44.769 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +2904us[+2881us] +/- 91ms 2023-07-20T15:11:44.769 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-20T15:11:44.778 INFO:teuthology.orchestra.run.smithi178.stderr:bash: ntpq: command not found 2023-07-20T15:11:44.781 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-20T15:11:44.782 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2023-07-20T15:11:44.782 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 10 -1515us[-1515us] +/- 86ms 2023-07-20T15:11:44.782 INFO:teuthology.orchestra.run.smithi178.stdout:^* hv02.front.sepia.ceph.com 3 6 377 10 -869us[ -863us] +/- 63ms 2023-07-20T15:11:44.782 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 +2920us[+2920us] +/- 91ms 2023-07-20T15:11:44.783 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-20T15:11:44.783 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-20T15:11:44.792 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-20T15:11:44.793 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-20T15:11:44.802 DEBUG:teuthology.orchestra.run.smithi029:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-20T15:11:44.909 DEBUG:teuthology.orchestra.run.smithi178:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-20T15:11:44.998 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-20T15:11:45.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T15:11:45.033 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-20T15:11:45.064 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T15:11:45.065 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-20T15:11:45.074 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-20T15:11:45.084 INFO:teuthology.task.internal:Duration was 1279.356999 seconds 2023-07-20T15:11:45.084 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-20T15:11:45.094 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-20T15:11:45.095 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-20T15:11:45.097 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-20T15:11:45.145 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-20T15:11:45.151 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-20T15:11:45.463 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-20T15:11:45.463 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2023-07-20T15:11:45.464 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-20T15:11:45.488 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi178.front.sepia.ceph.com 2023-07-20T15:11:45.489 DEBUG:teuthology.orchestra.run.smithi178:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-20T15:11:45.511 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-20T15:11:45.511 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-20T15:11:45.531 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-20T15:11:45.609 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-20T15:11:45.610 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-20T15:11:45.612 DEBUG:teuthology.orchestra.run.smithi178:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-20T15:11:45.793 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-20T15:11:45.802 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-20T15:11:45.803 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-20T15:11:45.831 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-20T15:11:45.860 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-20T15:11:45.869 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-20T15:11:45.873 DEBUG:teuthology.orchestra.run.smithi178:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-20T15:11:45.898 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2023-07-20T15:11:45.926 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = core 2023-07-20T15:11:45.945 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-20T15:11:45.979 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T15:11:45.980 DEBUG:teuthology.orchestra.run.smithi178:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-20T15:11:46.002 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T15:11:46.002 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-20T15:11:46.013 INFO:teuthology.task.internal:Transferring archived files... 2023-07-20T15:11:46.014 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344744/remote/smithi029 2023-07-20T15:11:46.015 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-20T15:11:46.062 DEBUG:teuthology.misc:Transferring archived files from smithi178:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344744/remote/smithi178 2023-07-20T15:11:46.063 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-20T15:11:46.102 INFO:teuthology.task.internal:Removing archive directory... 2023-07-20T15:11:46.102 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-20T15:11:46.104 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-20T15:11:46.154 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-20T15:11:46.165 INFO:teuthology.task.internal:Not uploading archives. 2023-07-20T15:11:46.166 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-20T15:11:46.176 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-20T15:11:46.176 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-20T15:11:46.179 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-20T15:11:46.195 INFO:teuthology.orchestra.run.smithi029.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 20 15:11 /home/ubuntu/cephtest 2023-07-20T15:11:46.212 INFO:teuthology.orchestra.run.smithi178.stdout: 525343 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 20 15:11 /home/ubuntu/cephtest 2023-07-20T15:11:46.214 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-20T15:11:46.224 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-20T15:11:46.250 INFO:teuthology.nuke:Checking targets against current locks 2023-07-20T15:11:46.278 DEBUG:teuthology.nuke:shortname: smithi029 2023-07-20T15:11:46.279 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T15:11:46.306 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 14:35:25.340065', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMXto2wFjvs7fQdmwJRE7emCUnrJz4bhhDfFJaNs9byXJ7bFQiVuzXXX7+zXu0Oy4L0oBzK72Cr013V96NWZSMQ='} 2023-07-20T15:11:46.308 DEBUG:teuthology.nuke:shortname: smithi178 2023-07-20T15:11:46.309 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T15:11:46.334 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 14:35:25.338281', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDF5+YVRmvOD2mNlTnr16YnQVBvcMvmgdz1UfZjaHtEg3e0Kz6Se48m9gn4GRbPFHV0e2yfG6kr4mWYcsrJizd1u9VqvE17S7WgYmNOWNKcYFrNPucGlADEkd5HprWMojIvR/yd+MDM54kNH44qCloJLe2XlcjJ+bc/akQjkTEOml6AkgG3JkcqvO2OZ0lP7u3mvazZW8VNMeLjgm4aH5NEb3LDn3uC1dWzpP0gcjpDUsOs12nH9ut66e6UNp+Zo3nx2yb+wzLMaMNa+Yc4/Hp4+Ebjz4xFHRHoNnBCtCAIXRdNI0GFh8tl3UXE0qW3pVaF/sxMiIhrXnTn/0MSiaoal/hLy47Tz+CuWMo1cODxGJpRZ8Dnru6bMhjj6f47Q+3+srWV9RbUxUKH5417n/GNS9Uue1rqKHlGkQndK6vBph4lWI5nM2t75OaFlskpk9Shi4qADVW3iWmYfYRawjrvhg4cmJ5nkU+ty6WH77qKQtmsdrrqHcheAMRsVE2kAh8='} 2023-07-20T15:11:46.361 INFO:teuthology.orchestra.console:Power off smithi029 2023-07-20T15:11:46.363 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T15:11:46.390 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T15:11:46.421 INFO:teuthology.orchestra.console:Power off smithi178 2023-07-20T15:11:46.422 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T15:11:46.443 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T15:11:50.413 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T15:11:50.466 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T15:11:54.527 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T15:11:54.577 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T15:11:54.738 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2023-07-20T15:11:54.788 INFO:teuthology.orchestra.console:Power off for smithi178 completed 2023-07-20T15:11:54.895 INFO:teuthology.run:Summary data: description: rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} duration: 1279.356998682022 failure_reason: 'Command failed on smithi029 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 021c9860-270e-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c \''ceph versions | jq -e \''"\''"\''.overall | length == 1\''"\''"\''\''''' owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=92b9cc6e24124694bda2b3cf0e401eb9 status: fail success: false 2023-07-20T15:11:54.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T15:11:54.987 INFO:teuthology.run:FAIL